-- Logs begin at Mon 2022-07-25 04:47:26 UTC, end at Mon 2022-07-25 05:55:58 UTC. -- Jul 25 05:28:15.120005 dv-cinder-850830-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 05:28:15.127392 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 05:28:15 2022] *** Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: nodename: dv-cinder-850830-1-iscsi Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: machine: x86_64 Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: clock source: unix Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: pcre jit disabled Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: detected number of CPU cores: 4 Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: current working directory: / Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: detected binary path: /usr/bin/uwsgi-core Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: your processes number limit is 47680 Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: your memory page size is 4096 bytes Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: detected max file descriptor number: 2048 Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: lock engine: pthread robust mutexes Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: thunder lock: enabled Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 05:28:15.132864 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 05:28:15.175955 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: Python main interpreter initialized at 0x55fba70269c0 Jul 25 05:28:15.175955 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: python threads support enabled Jul 25 05:28:15.175955 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: your server socket listen backlog is limited to 100 connections Jul 25 05:28:15.175955 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: your mercy for graceful operations on workers is 90 seconds Jul 25 05:28:15.176299 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 05:28:15.176375 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: *** Operational MODE: preforking *** Jul 25 05:28:15.176623 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: *** uWSGI is running in multiple interpreter mode *** Jul 25 05:28:15.176623 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: spawned uWSGI master process (pid: 103474) Jul 25 05:28:15.176849 dv-cinder-850830-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 05:28:15.177406 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: spawned uWSGI worker 1 (pid: 103475, cores: 1) Jul 25 05:28:15.177739 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: spawned uWSGI worker 2 (pid: 103476, cores: 1) Jul 25 05:28:15.177911 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 05:28:15.838444 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:28:15.843070 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:28:16.961354 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:28:16.961354 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: from cryptography.utils import int_from_bytes Jul 25 05:28:16.961933 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:28:16.961933 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: from cryptography.utils import int_from_bytes Jul 25 05:28:16.964663 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:28:16.964663 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: from cryptography.utils import int_from_bytes Jul 25 05:28:16.965212 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:28:16.965212 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: from cryptography.utils import int_from_bytes Jul 25 05:28:19.454256 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:28:19.455041 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:28:19.455041 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:28:19.455361 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:28:19.455614 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:28:19.455994 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.456311 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:28:19.456701 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.456815 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:28:19.456903 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.456999 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.457092 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:28:19.457264 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.457455 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:28:19.457553 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.457712 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:28:19.457874 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.458096 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.458194 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.458423 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.458511 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.458743 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.458844 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.459056 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.459149 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.459378 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850830-1-iscsi {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.459466 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.459683 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.459771 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.459985 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.460091 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.460292 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.460393 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.460603 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.460710 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.460897 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.460988 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.461215 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.461316 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.461524 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.461621 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850830-1-iscsi {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.461847 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.462024 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.462158 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.463168 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.463310 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.463422 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.463551 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.463648 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.463737 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.463832 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.463927 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.463927 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.464125 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.464125 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.464338 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.464436 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.464519 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.464648 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.464733 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.464878 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.465072 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.465208 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.465407 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.465563 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850830-1-iscsi {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.465707 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.465876 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.466557 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.466842 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.466931 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.467075 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.467162 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.467394 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.467495 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.467699 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.467838 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.468004 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.468124 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850830-1-iscsi {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.468320 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.468423 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.468639 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.468735 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.468981 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.469216 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.469370 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.469602 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.469704 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.469918 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.470044 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.470227 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.470334 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.470524 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.470632 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.470828 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.470929 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.471132 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.471230 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.471444 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.471548 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.471746 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.471850 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.472045 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.472134 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.472291 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.472390 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.472592 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.472687 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.472932 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.473023 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.473250 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.473352 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.473567 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.473669 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.473816 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.473916 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.474063 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.474152 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.474376 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.474474 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.474687 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.474774 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.474990 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.475086 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.475291 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.475389 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.475591 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.475685 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.475858 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.475958 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.476110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.476200 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.476428 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.476517 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.476750 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.476881 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.477072 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.477170 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.477375 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.477468 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.477683 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.477788 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.477985 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.478074 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.478286 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.478373 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.478588 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.478683 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.478891 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.478979 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.479196 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.479293 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.479505 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.479601 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.479817 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.479905 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.480139 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.480233 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.480443 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.480588 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.480758 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.480877 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.481096 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.481202 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.481399 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.481497 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.482273 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.482369 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.482577 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.482800 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.482900 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.483127 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.483216 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.483439 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.483529 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.483724 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.483831 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.484020 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.484108 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.484318 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.484413 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.484632 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.484737 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.484959 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.485054 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.485261 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.485359 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.485562 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.485658 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.485856 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.485944 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.486135 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.486299 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.486460 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.486614 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.486791 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.486926 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.487065 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.487210 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.487358 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.487516 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.487651 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.487737 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.487871 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.487968 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.488169 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.488259 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.488481 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.488576 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.488810 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.488903 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.489119 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.489213 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.489421 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.489510 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.489722 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.489820 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.490021 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.490116 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.490321 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.490481 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.490627 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.490735 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.490921 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.491010 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.491221 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.491316 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.491535 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.491638 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.491834 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.491922 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.492131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.492218 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.492434 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.492530 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.492733 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.492850 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.493057 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.493166 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.493368 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.493471 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.493665 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.493754 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.493964 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.494059 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.494276 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.494372 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.494576 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.494663 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.494874 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.494960 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.495169 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.495265 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.495468 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.495555 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.495764 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.495858 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.496063 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.496160 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.496357 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.496446 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.496654 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.496743 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.496971 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.497065 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.497304 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.497397 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.497722 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.497828 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.498031 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.498120 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.498333 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.498421 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.498639 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.498734 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.498940 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.499036 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.499242 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.499338 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.499541 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.499629 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.499858 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.499954 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.500179 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.500266 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.500492 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.500612 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.500813 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.500917 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.501120 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.501221 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.501437 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:28:19.501536 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.501763 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.501852 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.502088 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.502177 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.502399 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.502502 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.502708 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.502804 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.503017 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.503105 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.503332 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.503422 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.503645 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.503741 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.503971 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.504059 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.504283 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.504373 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.504595 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.504683 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.504930 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.505113 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.505239 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.505335 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.505548 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.505637 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.505867 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.505956 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.506181 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.506270 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.506491 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.506612 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.506828 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.506940 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.507171 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.507272 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.507481 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.507569 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.507803 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.507891 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.508123 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.508220 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.508430 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.508519 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.508742 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.508866 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.509076 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.509167 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.509399 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.509492 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.509725 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.509822 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.510035 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.510124 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.510351 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.510447 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.510660 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.510761 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.510972 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.511072 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.511275 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.511365 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.511582 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.511680 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.511891 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.511979 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.512219 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.512306 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.512533 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.512630 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.512889 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.513028 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.513204 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.513348 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.513521 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.513673 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.513831 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.513995 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.514139 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.514312 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.514446 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.514628 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.514748 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.514969 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.515058 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.515292 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.515389 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.515612 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.515701 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.515918 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.516005 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.516235 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.516334 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.516548 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.516635 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.516875 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.516977 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.517193 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.517364 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.517519 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.517658 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.517826 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.517969 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.518090 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.518181 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.518400 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.518488 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.518702 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.518791 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.519010 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.519100 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.519315 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.519403 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.519618 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.519713 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.519939 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.520030 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.520246 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.520342 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.520548 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.520645 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.520880 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.520973 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.521182 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.521272 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.521484 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.521591 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.521796 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.521883 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.522099 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.522187 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.522406 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.522502 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.522712 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.522799 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.523019 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.523108 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.523324 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.523420 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.523637 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.523724 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.523963 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.524064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.524250 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.524339 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.524566 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.524656 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.524898 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.524990 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.525210 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.525300 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.525523 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.525617 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.525835 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.525970 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.526134 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.526231 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.526441 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.526529 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.526742 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.526838 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.527043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.527133 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.527345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.527439 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.527649 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.527746 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.527949 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.528037 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.528258 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.528347 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.529482 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.529764 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.529856 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.530089 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.530177 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.530396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.530484 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.530706 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.530797 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.531014 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.531115 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.531319 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.531409 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.531622 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.531711 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.531925 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.532012 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.532230 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.532397 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.532537 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.532627 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.532866 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.532960 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.533195 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.533302 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.533508 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.533604 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.533814 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.533903 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.534121 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.534220 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.534434 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.534524 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.534741 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.534834 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.535051 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.535153 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.535361 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.535450 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.535671 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.535766 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.535989 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.536078 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.536299 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.536396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.536616 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.536705 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.536959 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.537051 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.537271 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.537369 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.537579 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.537669 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.537889 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.537979 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.538191 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.538332 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.538502 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.538637 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.538811 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.538952 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.539130 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.539278 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.539443 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.539578 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.539767 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.539903 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.540075 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.540209 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.540385 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.540532 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.540672 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.540859 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.541018 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.541149 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.541328 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.541482 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.541624 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.541763 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.541937 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.542078 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.542245 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.542394 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.542546 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.542681 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.542853 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.542995 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.543173 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.543327 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.543474 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.543624 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.543768 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.543904 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.544108 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.544731 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.545054 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.545195 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.545347 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.545482 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.545668 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.545827 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.545968 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.546105 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.546274 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.546414 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.546592 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.546739 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.546900 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.547037 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.547207 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.547346 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.547495 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.547636 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.547802 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.547900 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.548103 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.548239 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.548410 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.548501 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.548727 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.548852 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.549061 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.549167 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.549369 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.549460 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.549674 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.549762 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.549981 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.550078 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.550286 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.550374 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.550590 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.550677 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.550894 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.550994 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.551209 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.551338 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.551520 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.551611 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.551831 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.551929 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.552138 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.552234 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.552453 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.552542 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.552754 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.552877 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.553081 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.553184 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.553385 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.553473 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.553696 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.553784 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.553997 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.554087 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.554299 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.554394 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.554600 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.554691 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.554930 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.555019 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.555237 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.555329 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.555540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.555702 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.555842 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.555994 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.556140 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.556290 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.556433 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.556571 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.556736 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.556905 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.557067 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.557219 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.557358 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.557495 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.557677 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.557814 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.557989 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.558132 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.558294 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.558439 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.558606 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.558741 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.558912 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.559061 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.559220 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.559366 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.559526 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.559697 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.559842 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.559978 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.560165 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.560305 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.560481 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.560620 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.560818 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.560970 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.561109 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.561246 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.561418 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.561519 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.561732 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.561883 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.562022 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.562334 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.562466 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.562643 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.562793 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.562953 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.563099 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.563262 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.563401 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.563570 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.563728 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.563880 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.563971 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.564197 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.564286 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.564520 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.564764 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.564874 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.565116 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.565224 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.565433 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.565522 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.565754 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.565851 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.566056 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.566143 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.566365 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.566453 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.566668 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.566765 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.566972 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.567060 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.567274 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.567362 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.567578 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.567691 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.567881 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.567983 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.568184 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.568281 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.568491 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.568647 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.568834 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.568972 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.569111 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.569250 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.569385 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.569533 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.569681 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.569825 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.569984 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.570131 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.570279 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.570417 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.570585 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.570724 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.570886 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.571023 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.571188 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.571329 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.571488 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.571643 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.571778 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.571915 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.572085 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.572225 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.572391 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.572530 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.572714 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.572873 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.573048 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.573192 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.573353 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.573493 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.573641 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.574035 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.574181 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.574328 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.574533 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.574678 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.574838 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.574985 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.575131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.575271 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.575460 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.575596 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.575768 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.575897 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.576072 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.576161 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.576379 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.576467 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.576684 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.576819 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.577014 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.577115 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.577320 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.577410 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.577620 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.577722 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.577927 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.578066 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.578227 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.578367 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.578518 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.578653 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.578824 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.578965 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.579124 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.579268 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.579416 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.579552 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.579707 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.579847 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.579992 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.580137 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.580283 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.580420 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.580580 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.580726 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.580917 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.581064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.581225 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.581358 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.581525 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.581680 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.581826 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.581921 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.582115 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.582204 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.582418 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.582513 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.582720 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.582817 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.583021 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.583110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.583322 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.583410 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.583632 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.583731 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.583932 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.584021 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.584231 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.584327 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.584535 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.584623 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.584858 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.584952 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.585173 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.585271 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.585444 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.585529 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.585769 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.585858 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.586079 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.586168 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.586380 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.586476 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.586682 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.586776 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.586982 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.587078 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.587285 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.587374 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.587586 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.587673 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.587891 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.588035 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.588195 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.588284 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.588496 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.588585 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.588814 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.588923 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.589123 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.589212 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.589462 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.589551 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.589789 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.589892 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.590090 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.590178 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.590389 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.590476 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.590691 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.590855 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.591496 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.591587 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.591871 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.592187 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.592340 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.592477 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.592477 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.592733 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.592915 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.593065 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.593217 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.593357 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.593495 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.593635 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.593772 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.593921 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.594068 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.594212 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.594349 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.594496 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.594641 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.594779 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.594926 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.595062 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.595229 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.595378 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.595542 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.595690 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.595842 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.595976 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.596135 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.596270 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.596456 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.596605 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.596766 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.596931 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.597094 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.597228 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.597412 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.597556 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.597721 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.597873 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.598036 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.598173 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.598338 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.598485 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.598627 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.598789 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.598933 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.599067 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.599227 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.599377 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.599517 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.599652 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.599827 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.599969 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.600118 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.600266 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.600425 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.600561 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.600731 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.600899 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.601048 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.601185 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.601357 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.601496 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.601652 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.601802 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.601950 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.602086 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.602241 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.602332 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.602544 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.602852 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.602941 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.603158 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.603245 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.603459 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.603560 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.603766 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.603892 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.604066 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.604155 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.604371 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.604469 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.604672 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.604761 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.605000 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.605122 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.605327 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.605426 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.605638 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.605727 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.605947 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.606036 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.606258 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.606348 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.606654 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.607378 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.607472 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.607596 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.607756 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.607914 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.608065 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.608352 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.608480 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.608671 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.608803 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.609013 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.609106 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.609326 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.609414 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.609645 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.609752 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.609965 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.610056 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.610285 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.610371 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.610602 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.610703 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.610903 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.610991 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.611206 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.611320 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.611509 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.611636 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.611829 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.611950 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.612134 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.612263 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.612454 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.612573 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.612889 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.612984 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.613202 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.613291 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.613506 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.613597 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.613841 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.613931 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.614140 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.614238 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.614455 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.614543 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.614781 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.614870 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.615090 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.615253 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.615414 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.615509 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.615716 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.615830 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.616027 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.616171 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.616335 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.616424 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.616656 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.616866 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.617001 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.617182 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.617295 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.617496 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.617608 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.617821 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.617919 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.618146 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.618236 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.618471 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.618563 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.618779 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.618866 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.619095 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.619194 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.619406 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.619529 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.619732 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.619850 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.620057 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.620156 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.620370 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.620460 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.620686 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.620811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.621017 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.621118 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.621342 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.621431 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.621667 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.621757 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.621963 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.622062 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.622297 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.622478 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.622638 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.622785 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.623003 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.623147 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.623318 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.623455 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.623627 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.623766 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.623931 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.624079 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.624220 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.624311 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.624524 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.624613 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.624868 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.624962 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.625176 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.625265 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.625482 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.625583 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.625796 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.625887 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.626104 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.626252 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.626418 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.626517 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.626719 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.626807 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.627028 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.627116 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.627334 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.627435 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.627638 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.627727 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.627946 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.628035 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.628248 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.628350 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.628570 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.628658 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.628901 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.628993 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.629225 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.629327 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.629547 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.629635 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.629858 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.629948 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.630168 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.630257 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.630483 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.630571 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.630792 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.630889 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.631099 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.631190 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.631407 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.631497 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.631729 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.631826 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.632034 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.632125 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.632336 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.632424 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.632642 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.632732 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.632970 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.633062 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.633274 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.633364 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.633577 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.633678 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.633882 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.633982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.634185 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.634275 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.634488 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.634586 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.634791 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.634886 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.635110 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.635201 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.635415 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.635514 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.635735 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.635824 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.636040 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.636130 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.636341 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.636440 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.636645 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.636733 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.636974 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.637077 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.637283 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.637374 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.637591 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.637679 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.637961 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.638065 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.638291 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.638381 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.638601 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.638692 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.638927 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.639015 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.639240 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.639382 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.639546 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.639692 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.639856 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.639993 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.640165 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.640302 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.640482 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.640618 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.640825 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.640979 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.641120 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.641258 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.641428 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.641568 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.641742 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.641890 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.642049 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.642200 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.642361 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.642500 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.642673 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.642837 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.642988 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.643139 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.643304 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.643502 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.643623 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.643826 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.643939 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.644140 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.644261 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.644449 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.644579 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.644756 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.644909 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.645092 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.645219 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.645402 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.645538 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.645712 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.645853 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.646020 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.646170 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.646328 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.646634 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.646727 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.646955 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.647052 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.647274 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.647362 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.647597 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.647694 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.647936 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.648043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.648238 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.648336 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.648549 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.648638 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.648883 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.648977 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.649195 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.649339 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.649505 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.649594 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.649819 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.649916 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.650133 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.650223 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.650445 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.650533 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.650757 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.650845 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.651071 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.651162 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.651379 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.651467 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.651688 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.651776 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.652000 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.652090 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.652311 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.652400 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.652623 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.652797 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.652958 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.653110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.653271 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.653917 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.654107 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.654252 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.654428 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.654562 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.654764 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.654902 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.655118 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.655280 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.655435 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.655568 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.655708 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.655847 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.656004 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.656142 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.656367 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.656490 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.656667 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.656871 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.657021 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.657162 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.657308 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.657444 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.657619 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.657760 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.657958 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.658106 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.658282 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.658422 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.658600 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.658776 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.658914 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.659053 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.659220 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.659313 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.659567 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.659740 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.659876 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.660059 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.660198 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.660397 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.660537 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.660725 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.660895 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.661075 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.661214 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.661390 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.661538 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.661699 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.661838 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.662028 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.662228 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.662370 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.662570 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.662710 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.662884 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.662982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.663206 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.663295 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.663523 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.663613 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.663839 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.663934 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.664145 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.664234 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.664447 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.664544 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.664761 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.664883 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.665091 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.665188 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.665403 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.665622 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.665713 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.665966 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.666055 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.666284 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.666373 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.666591 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.666685 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.666897 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.666992 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.667199 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.667296 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.667504 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.667619 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.667806 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.667902 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.668132 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.668220 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.668435 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.668522 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.668740 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.668945 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.669142 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.669757 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.670038 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.670127 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.670348 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.670450 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.670653 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.670741 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.670959 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.671048 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.671263 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.671362 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.671574 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.671670 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.671878 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.671967 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.672185 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.672282 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.672488 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.672578 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.672807 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.672911 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.673119 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.673216 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.673427 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.673516 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.673730 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.673819 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.674037 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.674128 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.674345 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.674440 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.674655 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.674744 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.674966 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.675061 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.675269 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.675357 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.675583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.675671 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.675888 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.675978 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.676193 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.676280 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.676495 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.676593 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.676831 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.676978 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.677182 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.677379 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.677515 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.677715 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.677855 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.678033 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.678181 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.678371 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.678518 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.678687 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.678827 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.678994 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.679085 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.679299 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.679390 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.679603 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.679693 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.679926 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.680066 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.680234 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.680383 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.680542 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.680765 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.680925 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.681125 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.681274 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.681447 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.681588 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.681762 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.681908 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.682068 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.682211 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.682378 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.682521 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.682682 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.682801 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.682975 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.683114 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.683272 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.683411 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.683572 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.683722 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.683867 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.684018 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.684163 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.684303 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.684491 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.684629 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.684872 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.685093 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.685288 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.685430 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.685571 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.685723 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.685863 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.686012 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.686160 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.686300 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.686439 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.686578 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.686732 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.686885 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.687020 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.687157 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.687291 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.687432 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.687600 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.687737 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.687874 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.688015 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.688150 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.688284 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.688468 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.688603 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.688833 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.688976 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.689113 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.689264 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.689412 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.689552 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.689726 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.689868 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.690041 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.690144 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.690353 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.690454 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.690659 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.690747 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.690977 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.691075 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.691285 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.691380 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.691589 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.691685 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.691933 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.692023 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.692261 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.692349 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.692582 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.692672 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.692909 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.693004 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.693216 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.693305 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.693518 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.693621 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.693825 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.693915 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.694142 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.694231 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.694453 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.694555 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.694754 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.694843 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.695056 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.695145 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.695362 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.695459 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.695662 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.695752 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.695962 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.696050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.696265 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.696363 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.696567 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.696656 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.696895 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.696997 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.697197 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.697297 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.697496 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.697585 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.697794 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.697885 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.698095 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.698193 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.698399 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.698487 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.698951 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.699045 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.699258 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.699355 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.699556 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.699650 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.699857 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.699952 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.700157 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.700250 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.700481 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.700622 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.700802 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.700896 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.701203 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.701293 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.701511 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.701600 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.701818 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.701916 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.702125 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.702214 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.702431 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.702519 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.702741 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.702839 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.703046 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.703136 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.703350 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.703440 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.703655 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.703757 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.703962 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.704052 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.704314 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.704411 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.704602 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.704701 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.704947 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.705037 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.705260 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.705348 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.705572 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.705669 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.705879 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.705967 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.706231 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.706325 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.706481 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.706580 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.706803 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.706891 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.707124 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.707279 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.707425 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.707568 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.707731 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.707866 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.708045 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.708197 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.708368 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.708505 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.708680 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.708858 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.708996 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.709147 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.709324 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.709417 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.709633 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.709722 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.709941 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.710040 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.710249 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.710345 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.710558 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.710648 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.710865 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.710956 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.711177 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.711266 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.711483 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.711579 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.711792 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.711883 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.712106 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.712194 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.712413 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.712501 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.712738 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.712848 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.713072 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.713206 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.713384 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.713473 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.713693 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.713785 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.714003 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.714092 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.714315 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.714419 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.714637 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.714726 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.714950 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.715039 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.715261 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.715358 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.715577 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.715666 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.715886 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.716494 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.716733 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.716963 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.717086 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.717229 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:28:19.717401 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.717731 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.718060 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.718409 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.718723 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.719069 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.719400 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.719718 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.720030 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.720339 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:28:19.720581 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:28:19.778291 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Registered counter for database nova_api Jul 25 05:28:19.781916 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO dbcounter [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Registered counter for database nova_api Jul 25 05:28:19.891588 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:28:19.893820 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG oslo_db.sqlalchemy.engines [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:28:19.898252 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:28:19.900080 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writer thread running {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:28:19.954810 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.context [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0027c59-0b1b-4d95-bca5-9cf989836553(cell1) {{(pid=103475) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:28:19.955009 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.context [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0027c59-0b1b-4d95-bca5-9cf989836553(cell1) {{(pid=103476) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:28:19.958685 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:28:19.958802 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG oslo_concurrency.lockutils [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:28:19.960287 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:28:19.960429 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG oslo_concurrency.lockutils [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:28:19.961090 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG oslo_concurrency.lockutils [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:28:19.961200 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:28:19.963196 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG oslo_concurrency.lockutils [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:28:19.963306 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:28:19.965164 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO dbcounter [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Registered counter for database nova_cell0 Jul 25 05:28:19.965274 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Registered counter for database nova_cell0 Jul 25 05:28:19.969693 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Registered counter for database nova_cell1 Jul 25 05:28:19.969889 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO dbcounter [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Registered counter for database nova_cell1 Jul 25 05:28:19.977111 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:28:19.979391 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG oslo_db.sqlalchemy.engines [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:28:19.981332 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG oslo_db.sqlalchemy.engines [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:28:19.982468 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:28:19.983123 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:28:19.987568 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writer thread running {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:28:19.992592 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writer thread running {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:28:20.124402 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:28:20.133322 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO dbcounter [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Registered counter for database nova_cell0 Jul 25 05:28:20.134371 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO dbcounter [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Registered counter for database nova_cell0 Jul 25 05:28:20.142654 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_db.sqlalchemy.engines [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:28:20.146190 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG oslo_db.sqlalchemy.engines [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:28:20.147155 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writer thread running {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:28:20.150495 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writer thread running {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:28:20.487854 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: WARNING keystonemiddleware.auth_token [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:28:20.488521 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:28:20.495275 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:28:20.495385 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: WARNING keystonemiddleware.auth_token [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:28:20.838293 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: WARNING keystonemiddleware.auth_token [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:28:20.839458 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:28:20.844488 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: WARNING keystonemiddleware.auth_token [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:28:20.845743 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: WARNING keystonemiddleware.auth_token [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:28:20.849815 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fba70269c0 pid: 103476 (default app) Jul 25 05:28:20.851010 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fba70269c0 pid: 103475 (default app) Jul 25 05:28:20.851892 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:28:20.853109 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-aef6dc63-acf5-4532-9025-cddec167f217 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 Jul 25 05:28:20.853523 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Mon Jul 25 05:28:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:29:37.062962 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:29:37.064352 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Jul 25 05:29:37.064931 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:29:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:29:37.076635 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_api:SELECT=3 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:29:37.077539 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_cell0:SELECT=3 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:29:37.078416 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_cell1:SELECT=3 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:29:37.079874 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:29:37.938372 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-e340f238-2f4f-4049-8239-fe360c0f8ed7 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:29:37.967962 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-e340f238-2f4f-4049-8239-fe360c0f8ed7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.896843 Jul 25 05:29:37.968851 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jul 25 05:29:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:29:40.244418 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:29:40.245489 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-3a367c93-b435-4503-9232-bcec1ece34d6 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 25 05:29:40.245881 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:29:40.703613 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-a2c8faf1-827c-4ef4-92f2-385d605f44db admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:40.722475 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:29:40.722475 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: warnings.warn(msg) Jul 25 05:29:40.754940 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-a2c8faf1-827c-4ef4-92f2-385d605f44db admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502429 Jul 25 05:29:40.755889 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 25 05:29:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:29:40.770450 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=3 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:29:40.771697 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell1:SELECT=3 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:29:40.772709 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell0:SELECT=3 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:29:40.773492 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:29:40.985039 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-563b040d-967c-4339-9670-be136ae3ad7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:40.988020 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:29:40.988020 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) Jul 25 05:29:41.054070 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-563b040d-967c-4339-9670-be136ae3ad7b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289915 Jul 25 05:29:41.054948 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jul 25 05:29:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:29:43.342363 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-a2c8faf1-827c-4ef4-92f2-385d605f44db admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:29:43.343380 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-a2c8faf1-827c-4ef4-92f2-385d605f44db admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 25 05:29:43.343937 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:29:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:29:44.020339 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-d962a552-158f-4522-9bb6-5b40559873e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:44.039330 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:29:44.039330 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) Jul 25 05:29:44.066403 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-d962a552-158f-4522-9bb6-5b40559873e3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.715783 Jul 25 05:29:44.073512 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 25 05:29:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:29:44.081323 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-1d811856-6fbb-45b7-accc-ed46168a6525 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:44.083053 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:29:44.083053 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: warnings.warn(msg) Jul 25 05:29:44.125000 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-1d811856-6fbb-45b7-accc-ed46168a6525 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048439 Jul 25 05:29:44.125620 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jul 25 05:29:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:29:46.413413 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-d962a552-158f-4522-9bb6-5b40559873e3 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:29:46.413413 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-d962a552-158f-4522-9bb6-5b40559873e3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 25 05:29:46.414366 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:29:46.828244 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-53cbac8b-2773-4b04-a8f7-f0f2295df786 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:46.851343 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-53cbac8b-2773-4b04-a8f7-f0f2295df786 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430774 Jul 25 05:29:46.851813 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 25 05:29:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 05:29:46.864110 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-1c9b2aed-56ea-4732-87ee-b1c5902c8b54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:46.887848 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-1c9b2aed-56ea-4732-87ee-b1c5902c8b54 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027985 Jul 25 05:29:46.888418 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jul 25 05:29:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:29:49.115164 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-53cbac8b-2773-4b04-a8f7-f0f2295df786 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:29:49.116336 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-53cbac8b-2773-4b04-a8f7-f0f2295df786 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Jul 25 05:29:49.117190 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:29:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:29:49.537018 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-05960a3b-69f4-4ab6-bc7f-68cf9356ab36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d3"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:49.568441 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-05960a3b-69f4-4ab6-bc7f-68cf9356ab36 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444953 Jul 25 05:29:49.569777 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 25 05:29:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:29:49.587138 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-95747510-9256-44c4-9080-d4c2663a51b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:49.618556 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-95747510-9256-44c4-9080-d4c2663a51b9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037591 Jul 25 05:29:49.620865 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jul 25 05:29:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:29:51.930343 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-05960a3b-69f4-4ab6-bc7f-68cf9356ab36 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:29:51.931265 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-05960a3b-69f4-4ab6-bc7f-68cf9356ab36 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 25 05:29:51.931992 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:29:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:29:52.356902 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-831fca97-9e4f-416d-b7b8-fea51c641077 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "vcpus": 4}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:52.375392 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-831fca97-9e4f-416d-b7b8-fea51c641077 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437484 Jul 25 05:29:52.375947 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 25 05:29:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:29:52.388576 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-ea4051c3-ff76-427d-a848-9b4bd52fd86f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:52.412219 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-ea4051c3-ff76-427d-a848-9b4bd52fd86f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027476 Jul 25 05:29:52.413155 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jul 25 05:29:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:29:54.683260 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-831fca97-9e4f-416d-b7b8-fea51c641077 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:29:54.684292 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-831fca97-9e4f-416d-b7b8-fea51c641077 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 25 05:29:54.684703 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:29:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:29:55.124007 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-53cc1bca-637b-4463-95e0-c686be4704db admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:29:55.147830 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-53cc1bca-637b-4463-95e0-c686be4704db admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.455913 Jul 25 05:29:55.148388 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jul 25 05:29:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:29:58.206657 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-831fca97-9e4f-416d-b7b8-fea51c641077 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:29:58.207667 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-831fca97-9e4f-416d-b7b8-fea51c641077 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001883 Jul 25 05:29:58.208080 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:29:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:29:58.659801 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-b00545d5-190f-4ce2-a53e-b95f14aa0d89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "id": "1", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:58.679833 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-b00545d5-190f-4ce2-a53e-b95f14aa0d89 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.465750 Jul 25 05:29:58.680391 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 25 05:29:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:29:58.692611 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-881f4d8c-11b9-4097-b155-5c7b38a7782c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:29:58.716012 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-881f4d8c-11b9-4097-b155-5c7b38a7782c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027298 Jul 25 05:29:58.716910 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jul 25 05:29:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:30:00.938535 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-b00545d5-190f-4ce2-a53e-b95f14aa0d89 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:00.940208 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-b00545d5-190f-4ce2-a53e-b95f14aa0d89 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 25 05:30:00.940585 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:30:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:01.336533 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-5f919238-e09d-42e2-97a3-803c19ccddb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "disk": 20}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:01.353682 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-5f919238-e09d-42e2-97a3-803c19ccddb5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.407012 Jul 25 05:30:01.354227 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 25 05:30:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 05:30:01.366866 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-55773a3e-860c-4095-bfb9-1b955f7867fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:01.389405 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-55773a3e-860c-4095-bfb9-1b955f7867fc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026160 Jul 25 05:30:01.389976 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jul 25 05:30:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:30:03.661458 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-5f919238-e09d-42e2-97a3-803c19ccddb5 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:03.663076 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-5f919238-e09d-42e2-97a3-803c19ccddb5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002433 Jul 25 05:30:03.663752 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:30:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:04.072111 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-6a1efefa-8ab2-45fe-a06b-cad6e013a691 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "swap": 0}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:04.091144 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-6a1efefa-8ab2-45fe-a06b-cad6e013a691 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.418387 Jul 25 05:30:04.091682 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 25 05:30:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 05:30:04.104363 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-268bbc77-3687-43cb-bb38-6198dd87a82c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:04.134523 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-268bbc77-3687-43cb-bb38-6198dd87a82c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033829 Jul 25 05:30:04.135777 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jul 25 05:30:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:30:06.404083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-6a1efefa-8ab2-45fe-a06b-cad6e013a691 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:06.405108 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-6a1efefa-8ab2-45fe-a06b-cad6e013a691 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 25 05:30:06.405505 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:30:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:06.851019 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-104e4562-0589-4a0a-a15d-3fe5360e974b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "disk": 80, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:06.868515 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-104e4562-0589-4a0a-a15d-3fe5360e974b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456418 Jul 25 05:30:06.869136 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 25 05:30:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:30:06.881069 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-1bdcdcbc-8456-43e1-9435-0a043b3cf0fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:06.904436 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-1bdcdcbc-8456-43e1-9435-0a043b3cf0fb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027279 Jul 25 05:30:06.905397 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jul 25 05:30:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:30:09.177946 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-104e4562-0589-4a0a-a15d-3fe5360e974b admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:09.178945 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-104e4562-0589-4a0a-a15d-3fe5360e974b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 25 05:30:09.179813 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:30:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:09.719673 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f8d66677-9732-4a27-b41f-786fa80a6b94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "id": "5", "swap": 0, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:09.738375 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-f8d66677-9732-4a27-b41f-786fa80a6b94 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.552887 Jul 25 05:30:09.739026 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 25 05:30:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:30:09.750982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-22044a8d-d2f0-409d-b384-66e0c259b115 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:09.755964 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:30:09.777599 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-22044a8d-d2f0-409d-b384-66e0c259b115 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030218 Jul 25 05:30:09.778127 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jul 25 05:30:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:30:29.438840 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f8d66677-9732-4a27-b41f-786fa80a6b94 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:29.439838 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-f8d66677-9732-4a27-b41f-786fa80a6b94 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 25 05:30:29.440228 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:29.833719 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-c840cf76-1ab2-4a96-8fdc-5395593bf2e0 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:29.850912 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-c840cf76-1ab2-4a96-8fdc-5395593bf2e0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404254 Jul 25 05:30:29.851450 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jul 25 05:30:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:30:30.924625 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f8d66677-9732-4a27-b41f-786fa80a6b94 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:30.926466 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-f8d66677-9732-4a27-b41f-786fa80a6b94 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002254 Jul 25 05:30:30.926855 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:30:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:31.449235 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-e776e240-0e17-4277-ba7a-b98f40acfd54 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:31.454839 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.wsgi [None req-e776e240-0e17-4277-ba7a-b98f40acfd54 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-e776e240-0e17-4277-ba7a-b98f40acfd54 admin admin] Request method failure captured: Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Accept: application/json Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Accept-Encoding: gzip, deflate Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Connection: keep-alive Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Content-Length: 0 Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Host: 10.222.0.33 Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Openstack-Api-Version: compute 2.90 Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Openstack-System-Scope: None Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: User-Agent: python-novaclient Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Auth-Token: gAAAAABi3ip2S10HONMtsTe_x6JuvJJV8fLMpNov88P5Q4ULYKerzlAqB_TdyP9iRacq2_DuEo9CgrQWqL_8e6mqXica9gp-0xOM-NK0bGtChNl5k_1h0IherkYVXdQPOoKIGYDMp5rKCmlGL7sqI1ojlL9iJ5hVqsdQxdNqqI90_36ImQTq3qc Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Domain-Id: None Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Domain-Name: None Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Identity-Status: Confirmed Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Is-Admin-Project: True Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Domain-Id: default Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Domain-Name: Default Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Name: admin Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Role: reader,member,admin Jul 25 05:30:31.458064 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Roles: reader,member,admin Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85f4644d3bc94e89a0061a116652482e"}]}] Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Tenant: admin Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Tenant-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Tenant-Name: admin Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User: admin Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Domain-Id: default Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Domain-Name: Default Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Id: 1eae540242d94c10b0ad33960a855f08 Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Name: admin Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: method: > Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: exception: Flavor 42 could not be found. Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: action_args: {'id': '42'} Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:30:31.459982 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:31.461050 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:31.462396 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-e776e240-0e17-4277-ba7a-b98f40acfd54 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:30:31.463702 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-e776e240-0e17-4277-ba7a-b98f40acfd54 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.396005 Jul 25 05:30:31.463702 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jul 25 05:30:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:30:31.469506 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-e562cd90-7ac5-47e5-8bba-29dbfcae14c9 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:31.473024 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:30:31.493388 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-e562cd90-7ac5-47e5-8bba-29dbfcae14c9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027414 Jul 25 05:30:31.493941 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 25 05:30:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:30:31.503717 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-ad5e1c77-3c8f-4675-b91b-b7ee07d79952 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:31.524616 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-ad5e1c77-3c8f-4675-b91b-b7ee07d79952 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024436 Jul 25 05:30:31.525192 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 25 05:30:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:30:31.535814 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f2b020f2-d7d8-45cd-afad-c984f18f6da0 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:31.542101 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.wsgi [None req-f2b020f2-d7d8-45cd-afad-c984f18f6da0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f2b020f2-d7d8-45cd-afad-c984f18f6da0 admin admin] Request method failure captured: Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Accept: application/json Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Accept-Encoding: gzip, deflate Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Connection: keep-alive Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Content-Length: 0 Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Host: 10.222.0.33 Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Openstack-Api-Version: compute 2.90 Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Openstack-System-Scope: None Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: User-Agent: python-novaclient Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Auth-Token: gAAAAABi3ip2S10HONMtsTe_x6JuvJJV8fLMpNov88P5Q4ULYKerzlAqB_TdyP9iRacq2_DuEo9CgrQWqL_8e6mqXica9gp-0xOM-NK0bGtChNl5k_1h0IherkYVXdQPOoKIGYDMp5rKCmlGL7sqI1ojlL9iJ5hVqsdQxdNqqI90_36ImQTq3qc Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Domain-Id: None Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Domain-Name: None Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Identity-Status: Confirmed Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Is-Admin-Project: True Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Id: default Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Name: Default Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Name: admin Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Role: reader,member,admin Jul 25 05:30:31.545309 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Roles: reader,member,admin Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85f4644d3bc94e89a0061a116652482e"}]}] Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Tenant: admin Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Tenant-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Tenant-Name: admin Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User: admin Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Id: default Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Name: Default Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Id: 1eae540242d94c10b0ad33960a855f08 Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Name: admin Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: method: > Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: exception: Flavor 42 could not be found. Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: action_args: {'id': '42'} Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:30:31.546836 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:31.548005 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:31.549345 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f2b020f2-d7d8-45cd-afad-c984f18f6da0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:30:31.551108 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-f2b020f2-d7d8-45cd-afad-c984f18f6da0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015819 Jul 25 05:30:31.551108 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jul 25 05:30:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 05:30:32.528584 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-ad5e1c77-3c8f-4675-b91b-b7ee07d79952 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:32.529633 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-ad5e1c77-3c8f-4675-b91b-b7ee07d79952 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 25 05:30:32.530028 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:30:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:33.069790 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-60f1f6ba-0070-44fe-9331-28eb31204a29 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:33.075029 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.wsgi [None req-60f1f6ba-0070-44fe-9331-28eb31204a29 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-60f1f6ba-0070-44fe-9331-28eb31204a29 admin admin] Request method failure captured: Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Accept: application/json Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Accept-Encoding: gzip, deflate Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Connection: keep-alive Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Content-Length: 0 Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Host: 10.222.0.33 Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Openstack-Api-Version: compute 2.90 Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Openstack-System-Scope: None Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: User-Agent: python-novaclient Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Auth-Token: gAAAAABi3ip47DlE-lUbwwQflQdZoCXyIJw8oQtw4zQE2dpTxDuU6jUuryYpsMGdQSW6wpCbuDumwWcuohQ7Ao1TpME8yxpqs4qk5Muy4Syt2wKdFwza5MgK2s7olB8412-hJVrvFf1PXXzBdf0LTdEmMUVZ0wUX5kUDZkHWG4G5Mo-P5EMFdpY Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Domain-Id: None Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Domain-Name: None Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Identity-Status: Confirmed Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Is-Admin-Project: True Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Id: default Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Name: Default Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Name: admin Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Role: reader,member,admin Jul 25 05:30:33.076540 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Roles: reader,member,admin Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85f4644d3bc94e89a0061a116652482e"}]}] Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Tenant: admin Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Tenant-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Tenant-Name: admin Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User: admin Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Id: default Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Name: Default Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Id: 1eae540242d94c10b0ad33960a855f08 Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Name: admin Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: method: > Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: exception: Flavor 84 could not be found. Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: action_args: {'id': '84'} Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:30:33.078083 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:33.079043 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:33.080353 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-60f1f6ba-0070-44fe-9331-28eb31204a29 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:30:33.082007 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-60f1f6ba-0070-44fe-9331-28eb31204a29 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397935 Jul 25 05:30:33.082007 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jul 25 05:30:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:30:33.090036 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-462b20fa-1e09-4d51-ab94-69dc340060f4 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:33.104415 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-462b20fa-1e09-4d51-ab94-69dc340060f4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018028 Jul 25 05:30:33.105247 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 25 05:30:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:30:33.115813 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-94d90756-eab1-4e7c-a67c-1cbf9b786a77 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:33.129708 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-94d90756-eab1-4e7c-a67c-1cbf9b786a77 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018262 Jul 25 05:30:33.130218 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 25 05:30:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:30:33.139538 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-37127ba2-6100-4502-a8ae-6e854bfbf21f admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:33.145472 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.wsgi [None req-37127ba2-6100-4502-a8ae-6e854bfbf21f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-37127ba2-6100-4502-a8ae-6e854bfbf21f admin admin] Request method failure captured: Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Accept: application/json Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Accept-Encoding: gzip, deflate Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Connection: keep-alive Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Content-Length: 0 Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Host: 10.222.0.33 Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Openstack-Api-Version: compute 2.90 Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Openstack-System-Scope: None Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: User-Agent: python-novaclient Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Auth-Token: gAAAAABi3ip47DlE-lUbwwQflQdZoCXyIJw8oQtw4zQE2dpTxDuU6jUuryYpsMGdQSW6wpCbuDumwWcuohQ7Ao1TpME8yxpqs4qk5Muy4Syt2wKdFwza5MgK2s7olB8412-hJVrvFf1PXXzBdf0LTdEmMUVZ0wUX5kUDZkHWG4G5Mo-P5EMFdpY Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Domain-Id: None Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Domain-Name: None Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Identity-Status: Confirmed Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Is-Admin-Project: True Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Domain-Id: default Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Domain-Name: Default Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Name: admin Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Role: reader,member,admin Jul 25 05:30:33.146970 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Roles: reader,member,admin Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85f4644d3bc94e89a0061a116652482e"}]}] Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Tenant: admin Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Tenant-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Tenant-Name: admin Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User: admin Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Domain-Id: default Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Domain-Name: Default Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Id: 1eae540242d94c10b0ad33960a855f08 Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Name: admin Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: method: > Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: exception: Flavor 84 could not be found. Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: action_args: {'id': '84'} Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:30:33.148490 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:33.149553 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:33.150688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-37127ba2-6100-4502-a8ae-6e854bfbf21f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:30:33.151739 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-37127ba2-6100-4502-a8ae-6e854bfbf21f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012326 Jul 25 05:30:33.151739 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jul 25 05:30:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:30:34.127846 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-94d90756-eab1-4e7c-a67c-1cbf9b786a77 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:34.129443 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-94d90756-eab1-4e7c-a67c-1cbf9b786a77 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Jul 25 05:30:34.129829 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:30:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:34.653740 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-9c86eb42-7834-43bb-87fc-278621fb4c15 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:34.659905 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.wsgi [None req-9c86eb42-7834-43bb-87fc-278621fb4c15 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-9c86eb42-7834-43bb-87fc-278621fb4c15 admin admin] Request method failure captured: Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Accept: application/json Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Accept-Encoding: gzip, deflate Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Connection: keep-alive Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Content-Length: 0 Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Host: 10.222.0.33 Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Openstack-Api-Version: compute 2.90 Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Openstack-System-Scope: None Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: User-Agent: python-novaclient Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Auth-Token: gAAAAABi3ip6T6V7AbXa5190D78obF0WnZY0mV-ChiQi9zVwi60SLwGAdDL2g5WU56uNKvJd4Ek41le_dKkjp8b8vCX8m_co6fMg9qfDYf73pdTmcbgwb2KDP1734r3Qup7g_DO3CmGQ8g4nYRXaRF2rS40H-FdASOcUH0j_24opa6lp57H0_UA Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Domain-Id: None Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Domain-Name: None Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Identity-Status: Confirmed Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Is-Admin-Project: True Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Domain-Id: default Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Domain-Name: Default Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Project-Name: admin Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Role: reader,member,admin Jul 25 05:30:34.661484 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Roles: reader,member,admin Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85f4644d3bc94e89a0061a116652482e"}]}] Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Tenant: admin Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Tenant-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-Tenant-Name: admin Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User: admin Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Domain-Id: default Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Domain-Name: Default Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Id: 1eae540242d94c10b0ad33960a855f08 Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: X-User-Name: admin Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: method: > Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: exception: Flavor 451 could not be found. Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: action_args: {'id': '451'} Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:30:34.663110 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:34.664071 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: ERROR nova.api.openstack.wsgi Jul 25 05:30:34.665583 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-9c86eb42-7834-43bb-87fc-278621fb4c15 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:30:34.666961 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-9c86eb42-7834-43bb-87fc-278621fb4c15 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394325 Jul 25 05:30:34.666961 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 25 05:30:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:30:34.672564 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-4b3fd560-04c8-4a61-8a52-2de600fbab17 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:34.687433 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-4b3fd560-04c8-4a61-8a52-2de600fbab17 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018351 Jul 25 05:30:34.687975 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 25 05:30:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:30:34.697651 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:34.712534 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018438 Jul 25 05:30:34.713091 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 25 05:30:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:30:34.723117 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f8bb5d4c-98ea-472b-a805-7d6881102daf admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:34.728614 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.wsgi [None req-f8bb5d4c-98ea-472b-a805-7d6881102daf admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f8bb5d4c-98ea-472b-a805-7d6881102daf admin admin] Request method failure captured: Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Accept: application/json Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Accept-Encoding: gzip, deflate Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Connection: keep-alive Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Content-Length: 0 Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Host: 10.222.0.33 Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Openstack-Api-Version: compute 2.90 Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Openstack-System-Scope: None Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: User-Agent: python-novaclient Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Auth-Token: gAAAAABi3ip6T6V7AbXa5190D78obF0WnZY0mV-ChiQi9zVwi60SLwGAdDL2g5WU56uNKvJd4Ek41le_dKkjp8b8vCX8m_co6fMg9qfDYf73pdTmcbgwb2KDP1734r3Qup7g_DO3CmGQ8g4nYRXaRF2rS40H-FdASOcUH0j_24opa6lp57H0_UA Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Domain-Id: None Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Domain-Name: None Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Identity-Status: Confirmed Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Is-Admin-Project: True Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Id: default Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Domain-Name: Default Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Project-Name: admin Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Role: reader,member,admin Jul 25 05:30:34.730131 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Roles: reader,member,admin Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85f4644d3bc94e89a0061a116652482e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85f4644d3bc94e89a0061a116652482e"}]}] Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Tenant: admin Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Tenant-Id: 85f4644d3bc94e89a0061a116652482e Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-Tenant-Name: admin Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User: admin Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Id: default Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Domain-Name: Default Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Id: 1eae540242d94c10b0ad33960a855f08 Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: X-User-Name: admin Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: method: > Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: exception: Flavor 451 could not be found. Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: action_args: {'id': '451'} Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:30:34.731781 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:34.732811 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: ERROR nova.api.openstack.wsgi Jul 25 05:30:34.734146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f8bb5d4c-98ea-472b-a805-7d6881102daf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:30:34.735390 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-f8bb5d4c-98ea-472b-a805-7d6881102daf admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012819 Jul 25 05:30:34.735390 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 25 05:30:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:30:35.700840 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:35.701860 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 25 05:30:35.702250 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:30:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:36.257597 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-5ee7c204-eb99-46f8-9c37-fa6a5482eaec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:36.277197 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-5ee7c204-eb99-46f8-9c37-fa6a5482eaec admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.432124 Jul 25 05:30:36.277739 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jul 25 05:30:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:30:37.266469 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:37.267459 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 25 05:30:37.267851 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:30:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:37.810023 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-73346146-386f-4018-af0a-e25d6e2b877b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:37.828326 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-73346146-386f-4018-af0a-e25d6e2b877b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.422961 Jul 25 05:30:37.832881 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jul 25 05:30:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:30:38.839381 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:38.840373 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 25 05:30:38.840833 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:30:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:39.391483 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-b75e9ffb-c383-43e0-99ab-d29585f83eab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:39.415225 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-b75e9ffb-c383-43e0-99ab-d29585f83eab admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.433331 Jul 25 05:30:39.415783 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jul 25 05:30:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:30:40.412871 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:40.413864 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 25 05:30:40.414253 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:30:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:40.957105 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-8122d3cb-bba1-4d8e-9dca-cf1839454e50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:30:40.977149 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-8122d3cb-bba1-4d8e-9dca-cf1839454e50 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.422097 Jul 25 05:30:40.977810 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jul 25 05:30:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:30:41.979766 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:41.980833 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 25 05:30:41.981266 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:30:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:30:42.523789 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-58c73015-ff23-4af5-9b73-0851dd89a496 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:30:42.543829 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-58c73015-ff23-4af5-9b73-0851dd89a496 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.422720 Jul 25 05:30:42.544381 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Mon Jul 25 05:30:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:31:34.508688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:31:34.509745 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-78715f14-b23f-4de1-b07c-911e8c51b41b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 25 05:31:34.510145 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 25 05:31:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:31:34.521341 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:34.898558 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-f5456138-8e16-42ab-a82a-0b76a60cf4b7 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:31:34.918221 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-f5456138-8e16-42ab-a82a-0b76a60cf4b7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402203 Jul 25 05:31:34.918736 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jul 25 05:31:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:31:34.939688 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG dbcounter [-] [103476] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:34.943655 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-d55dfb12-154d-4f52-a908-053f965ab4f6 admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:31:34.951884 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-d55dfb12-154d-4f52-a908-053f965ab4f6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013674 Jul 25 05:31:34.952407 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1282 bytes} [Mon Jul 25 05:31:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:34.964384 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-9caad631-bb2f-4c02-b37e-5e4aff0d2256 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:31:34.972892 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-9caad631-bb2f-4c02-b37e-5e4aff0d2256 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012153 Jul 25 05:31:34.973399 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1285 bytes} [Mon Jul 25 05:31:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:34.984857 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-6a2a969c-df12-4835-9bc1-af32751def9e admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:31:34.993623 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-6a2a969c-df12-4835-9bc1-af32751def9e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012533 Jul 25 05:31:34.994150 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1285 bytes} [Mon Jul 25 05:31:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:35.005496 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-4916bfbf-54d7-4cce-a1eb-85f6e8afd7c4 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:31:35.012996 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-4916bfbf-54d7-4cce-a1eb-85f6e8afd7c4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011207 Jul 25 05:31:35.013497 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1282 bytes} [Mon Jul 25 05:31:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:35:04.461691 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-6a2a969c-df12-4835-9bc1-af32751def9e admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:35:04.462703 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-6a2a969c-df12-4835-9bc1-af32751def9e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jul 25 05:35:04.463096 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:35:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:35:04.601449 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=6 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:04.759848 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-43bf3704-d56f-4d52-b603-37fdcc348a99 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:35:04.761055 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:35:04.761055 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) Jul 25 05:35:04.762282 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-43bf3704-d56f-4d52-b603-37fdcc348a99 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:35:04.762717 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-43bf3704-d56f-4d52-b603-37fdcc348a99 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:35:04.763496 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-43bf3704-d56f-4d52-b603-37fdcc348a99 admin admin] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:35:04.763921 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-43bf3704-d56f-4d52-b603-37fdcc348a99 admin admin] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:35:04.806323 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-43bf3704-d56f-4d52-b603-37fdcc348a99 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.206151 Jul 25 05:35:04.807306 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 25 05:35:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:35:05.642381 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-6a2a969c-df12-4835-9bc1-af32751def9e admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:35:05.643376 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-6a2a969c-df12-4835-9bc1-af32751def9e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 25 05:35:05.643774 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:35:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:35:05.837975 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-8fc2b740-bac4-44db-bd7f-e039d7280ae1 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:35:05.839146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:35:05.839146 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) Jul 25 05:35:05.840364 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-8fc2b740-bac4-44db-bd7f-e039d7280ae1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:35:05.840825 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-8fc2b740-bac4-44db-bd7f-e039d7280ae1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:35:05.841628 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-8fc2b740-bac4-44db-bd7f-e039d7280ae1 admin admin] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:35:05.842052 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-8fc2b740-bac4-44db-bd7f-e039d7280ae1 admin admin] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:35:05.861589 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-8fc2b740-bac4-44db-bd7f-e039d7280ae1 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078981 Jul 25 05:35:05.862106 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 25 05:35:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:35:17.116316 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-6a2a969c-df12-4835-9bc1-af32751def9e admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:35:17.117371 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-6a2a969c-df12-4835-9bc1-af32751def9e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 25 05:35:17.117765 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:35:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:35:17.261041 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell0:SELECT=4 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:17.261823 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_cell1:SELECT=4 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:17.262230 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG dbcounter [-] [103475] Writing DB stats nova_api:SELECT=8 {{(pid=103475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:17.310706 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-3e57477d-ee8a-4b57-b127-b6a260c46a4c admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:35:17.311875 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:35:17.311875 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) Jul 25 05:35:17.313088 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3e57477d-ee8a-4b57-b127-b6a260c46a4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:35:17.313530 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3e57477d-ee8a-4b57-b127-b6a260c46a4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:35:17.314319 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3e57477d-ee8a-4b57-b127-b6a260c46a4c admin admin] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:35:17.314747 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-3e57477d-ee8a-4b57-b127-b6a260c46a4c admin admin] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:35:17.341342 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-3e57477d-ee8a-4b57-b127-b6a260c46a4c admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084744 Jul 25 05:35:17.341820 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 37/74] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 25 05:35:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:35:18.184647 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: DEBUG nova.api.openstack.wsgi [None req-6a2a969c-df12-4835-9bc1-af32751def9e admin admin] Calling method '>' {{(pid=103476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:35:18.185670 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: INFO nova.api.openstack.requestlog [None req-6a2a969c-df12-4835-9bc1-af32751def9e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 25 05:35:18.186067 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: [pid: 103476|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 25 05:35:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:35:18.375368 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG nova.api.openstack.wsgi [None req-e34f2230-d2dc-49e8-921d-b20245470ff1 admin admin] Calling method '>' {{(pid=103475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:35:18.376525 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:35:18.376525 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: warnings.warn(msg) Jul 25 05:35:18.377724 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-e34f2230-d2dc-49e8-921d-b20245470ff1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:35:18.378157 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-e34f2230-d2dc-49e8-921d-b20245470ff1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:35:18.378938 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-e34f2230-d2dc-49e8-921d-b20245470ff1 admin admin] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:35:18.379359 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: DEBUG oslo_concurrency.lockutils [None req-e34f2230-d2dc-49e8-921d-b20245470ff1 admin admin] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:35:18.400569 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: INFO nova.api.openstack.requestlog [None req-e34f2230-d2dc-49e8-921d-b20245470ff1 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077857 Jul 25 05:35:18.401066 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: [pid: 103475|app: 0|req: 38/76] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 25 05:35:18 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:36:15.299071 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: Mon Jul 25 05:36:15 2022 - graceful shutdown triggered... Jul 25 05:36:15.298595 dv-cinder-850830-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 05:36:15.300034 dv-cinder-850830-1-iscsi devstack@n-api.service[103475]: Gracefully killing worker 1 (pid: 103475)... Jul 25 05:36:15.300466 dv-cinder-850830-1-iscsi devstack@n-api.service[103476]: Gracefully killing worker 2 (pid: 103476)... Jul 25 05:36:16.299063 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: worker 1 buried after 1 seconds Jul 25 05:36:16.299210 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: worker 2 buried after 1 seconds Jul 25 05:36:16.299210 dv-cinder-850830-1-iscsi devstack@n-api.service[103474]: goodbye to uWSGI. Jul 25 05:36:16.300673 dv-cinder-850830-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 25 05:36:16.301257 dv-cinder-850830-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 05:36:16.304046 dv-cinder-850830-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 05:36:16.313600 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 05:36:16.315639 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 05:36:16 2022] *** Jul 25 05:36:16.315639 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 05:36:16.315639 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 05:36:16.315639 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: nodename: dv-cinder-850830-1-iscsi Jul 25 05:36:16.315639 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: machine: x86_64 Jul 25 05:36:16.315639 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: clock source: unix Jul 25 05:36:16.315639 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: pcre jit disabled Jul 25 05:36:16.315639 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: detected number of CPU cores: 4 Jul 25 05:36:16.315639 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: current working directory: / Jul 25 05:36:16.315639 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: detected binary path: /usr/bin/uwsgi-core Jul 25 05:36:16.315639 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: your processes number limit is 47680 Jul 25 05:36:16.316376 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: your memory page size is 4096 bytes Jul 25 05:36:16.316376 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: detected max file descriptor number: 2048 Jul 25 05:36:16.316376 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: lock engine: pthread robust mutexes Jul 25 05:36:16.316376 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: thunder lock: enabled Jul 25 05:36:16.316376 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 05:36:16.316376 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 05:36:16.362025 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: Python main interpreter initialized at 0x5634697c19c0 Jul 25 05:36:16.362025 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: python threads support enabled Jul 25 05:36:16.362025 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: your server socket listen backlog is limited to 100 connections Jul 25 05:36:16.362025 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: your mercy for graceful operations on workers is 90 seconds Jul 25 05:36:16.362441 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 05:36:16.362441 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: *** Operational MODE: preforking *** Jul 25 05:36:16.362744 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: *** uWSGI is running in multiple interpreter mode *** Jul 25 05:36:16.362744 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: spawned uWSGI master process (pid: 124452) Jul 25 05:36:16.362912 dv-cinder-850830-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 05:36:16.364937 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: spawned uWSGI worker 1 (pid: 124466, cores: 1) Jul 25 05:36:16.364937 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: spawned uWSGI worker 2 (pid: 124467, cores: 1) Jul 25 05:36:16.364937 dv-cinder-850830-1-iscsi devstack@n-api.service[124452]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 05:36:17.030507 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:36:17.036256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:36:18.231956 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:36:18.231956 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: from cryptography.utils import int_from_bytes Jul 25 05:36:18.232577 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:36:18.232577 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: from cryptography.utils import int_from_bytes Jul 25 05:36:18.260303 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:36:18.260303 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: from cryptography.utils import int_from_bytes Jul 25 05:36:18.260924 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:36:18.260924 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: from cryptography.utils import int_from_bytes Jul 25 05:36:20.546045 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:36:20.546952 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:36:20.547466 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:36:20.547837 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:36:20.548093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:36:20.548485 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.548843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.549173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.549493 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.549825 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.550135 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.550455 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.550776 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.551104 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.551366 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.551684 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.552011 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850830-1-iscsi {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.552345 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.552651 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.553015 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.553319 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.553623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.553948 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.554267 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.554771 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.555224 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.555542 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.555856 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.556196 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.556510 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.556837 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.557162 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.557482 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.558083 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.558210 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.559226 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850830-1-iscsi {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.559633 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.559970 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.560285 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.560702 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.561044 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.561356 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.561681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.562029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.562501 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.562668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.562985 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.563305 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.563627 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.563929 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.564239 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.564560 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.564912 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.565262 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.565571 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.565837 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.566143 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.566465 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.566797 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.567120 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.567373 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.567653 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.567944 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.568266 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.568571 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.568900 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.569207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.569514 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.569817 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.570123 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.570427 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.570731 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.571048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.571361 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.571682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.571990 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.572308 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.572702 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.572977 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.573284 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.573622 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.573976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.574367 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.574819 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.575143 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.575451 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.575762 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.576069 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.576385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.576719 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.577048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.577299 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.577859 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.578165 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.578483 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.578787 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.579092 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.579398 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.579697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.580002 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.580308 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.580611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.580938 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.581245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.581547 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.581851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.582153 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.582458 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.582776 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.583094 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.583399 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.583703 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.584006 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.584310 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.584629 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.584959 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.585267 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.585593 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.585897 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.586198 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.586515 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.586821 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.587124 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.587443 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.587740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.588045 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.588360 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.588665 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.589021 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.589310 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.589641 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.590096 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.590403 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.590711 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.591015 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.591331 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.591677 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.591968 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.592354 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.592569 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.592915 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.593237 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.593563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.593909 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.594246 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.595656 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.595656 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.595656 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.595656 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.596383 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.596383 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.596655 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.596816 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.597948 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.597948 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.597948 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.597948 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.598612 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.598612 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.598994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.599196 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.599506 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.599826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.600154 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.600477 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.600803 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.601148 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.601493 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.601808 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.602134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.602295 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:36:20.602776 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.602940 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:36:20.603101 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.603266 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:36:20.603423 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.603423 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.603716 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:36:20.603716 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:36:20.604011 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.604011 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.604304 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.604460 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.604610 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.604758 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.604959 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.605119 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.605776 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.605934 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.606083 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.606408 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.606575 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.606736 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.606897 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.607054 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.607210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.607371 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.607567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.607738 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.607895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.608052 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.608201 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.608359 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.608508 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850830-1-iscsi {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.608656 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.608840 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.609065 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.609219 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.609382 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.609540 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.609697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.609867 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.610023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.610172 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.610335 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.610484 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.610632 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.610792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.610941 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.610941 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.611234 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.611412 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.611582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.611741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.611892 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.612055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.612204 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.612352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.612500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.612655 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.612859 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.613033 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.613192 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.613337 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.613462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.613588 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.613732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.613877 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.614021 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.614162 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.614305 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.614437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.614437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.614670 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850830-1-iscsi {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.614784 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.614931 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.615065 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.615407 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.615558 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.615691 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.615821 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.615983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.616128 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.616327 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.616470 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.616711 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.616916 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.617134 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.617288 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.617443 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.617584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.617758 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.617904 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.618072 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.618222 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.618398 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.618536 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.618713 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.618858 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.619106 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.619265 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.619409 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.619542 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.619665 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.619808 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.619943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.620089 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.620233 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.620379 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.620524 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.620658 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.620975 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.621643 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.621746 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.621920 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.622105 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.622266 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.622541 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.622711 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.623018 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.623353 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.623612 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.623720 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.623883 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.623991 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.624189 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.624299 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.624522 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.624642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.624875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.625005 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.625170 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.625304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.625480 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.625790 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.626103 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.626212 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.626544 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.626855 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.627160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.627466 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.627814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.628127 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.628473 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.628832 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.629123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.629394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.629572 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.629727 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.629887 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.630045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.630204 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.630426 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.630593 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.630752 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.630909 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.631066 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.631216 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.631366 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.631530 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.631687 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.631839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.631994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.632152 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.632321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.632483 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.632633 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.632844 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.633015 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.633174 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.633339 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.633490 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.633639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.633795 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.633945 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.634102 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.634266 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.634424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.634600 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.634757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.634915 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.635073 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.635243 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.635393 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.635543 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.635699 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.635965 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.636141 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.636299 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.636487 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.636657 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.636843 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.637012 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.637204 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.637407 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.637569 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.637720 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.637868 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.638017 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.638176 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.638325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.638481 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.638631 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.638798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.638956 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.639120 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.639270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.639507 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.639663 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.639820 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.639979 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.640147 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.640298 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.640457 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.640607 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.640755 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.641053 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.641216 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.641366 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.641522 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.641671 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.641827 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.641991 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.642140 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.642299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.642460 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.642610 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.642758 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.642920 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.643088 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.643245 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.643402 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.643552 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.643708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.643867 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.644016 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.644172 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.644329 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.644487 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.644650 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.644825 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.644993 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.645167 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.645317 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.645317 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.645612 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.645771 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.645928 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.646251 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.646251 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.646552 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.646702 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.646970 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.647161 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.647336 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.647508 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.647667 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.647824 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.647980 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.648130 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.648293 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.648450 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.648608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.648758 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.648942 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.649106 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.649258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.649416 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.649416 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.649801 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.649966 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.650126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.650276 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.650426 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.650575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.650724 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.650872 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.651030 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.651180 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.651180 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.651180 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.651631 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.651781 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.651939 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.652133 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.652296 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.652446 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.652603 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.652768 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.652945 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.653105 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.653256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.653404 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.653404 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.653713 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.653871 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.654030 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.654189 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.654346 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.654496 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.654658 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.654816 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.654981 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.655131 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.655280 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:36:20.655429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.655597 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.655747 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.655905 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.656055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.656055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.656462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.656627 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.656823 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.656823 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.657127 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.657304 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.657463 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.657463 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.657757 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.657905 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.658070 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.658227 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.658388 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.658537 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.658693 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.658851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.659008 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.659158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.659317 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.659467 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.659643 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.659884 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.660039 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.660197 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.660197 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.660496 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.660654 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.660834 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.661001 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.661168 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.661326 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.661476 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.661631 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.661806 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.661972 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.662133 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.662292 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.662449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.662614 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.662764 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.662912 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.663068 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.663220 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.663376 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.663535 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.663702 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.663851 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.664008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.664157 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.664329 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.664602 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.664766 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.664979 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.665139 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.665290 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.665552 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.665826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.665990 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.666193 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.666522 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.666687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.666853 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.667002 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.667159 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.667308 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.667458 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.667607 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.668378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.668586 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.668932 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.669092 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.669254 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.669416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.669577 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.669759 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.670002 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.670158 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.670306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.670463 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.670622 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.670779 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.670961 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.671119 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.671298 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.671477 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.671637 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.671793 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.671942 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.672090 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.672238 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.672396 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.672546 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.672702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.672886 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.673053 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.673208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.673387 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.673538 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.673695 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.673845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.674009 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.674165 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.674325 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.674474 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.674622 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.674777 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.674933 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.675092 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.675241 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.675407 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.675556 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.675704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.675854 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.676082 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.676234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.676383 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.676662 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.676875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.677034 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.677193 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.677352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.677508 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.677709 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.677867 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.678026 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.678185 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.678421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.678577 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.678742 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.678890 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.679050 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.679206 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.679356 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.679598 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.679752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.679920 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.680169 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.680325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.680519 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.680954 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.681135 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.681288 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.681451 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.681601 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.681757 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.681915 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.682110 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.682427 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.682427 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.682746 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.682895 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.683052 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.683203 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.683431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.684087 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.684238 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.684388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.684536 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.684536 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.684862 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.685083 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.685252 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.685403 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.685560 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.685717 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.685876 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.686033 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.686183 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.686333 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.686481 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.686481 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.686888 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.687045 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.687205 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.687363 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.687521 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.687685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.687843 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.688001 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.688150 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.688298 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.688447 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.688605 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.688773 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.688965 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.688965 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.689260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.689410 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.689573 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.689738 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.689888 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.690196 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.690369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.690529 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.690694 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.690851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.691161 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.691318 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.691476 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.691654 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.691813 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.691962 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.692112 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.692260 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.692416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.692577 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.692736 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.692927 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.693089 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.693248 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.693408 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.693592 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.693744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.693893 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.694081 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.694235 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.694391 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.694555 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.694708 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.694865 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.694865 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.695156 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.695315 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.695480 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.695642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.695806 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.695958 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.696114 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.696274 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.696433 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.696621 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.696621 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.697084 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.697239 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.697437 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.697600 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.697750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.697918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.698068 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.698254 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.698254 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.698559 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.698718 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.698898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.699081 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.699242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.699400 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.699551 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.699709 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.699868 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.700039 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.700204 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.700440 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.700604 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.700766 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.700954 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.701431 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.701603 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.701763 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.701914 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.702072 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.702229 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.702390 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.702390 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.702959 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.703110 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.703268 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.703268 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.703609 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.703761 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.703918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.703918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.703918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.704360 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.704525 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.704525 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.704989 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.705147 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.705308 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.705467 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.705632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.705790 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.705941 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.706090 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.706247 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.706397 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.706556 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.706714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.706874 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.707032 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.707032 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.707442 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.707602 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.707760 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.707918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.708076 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.708234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.708408 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.708559 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.708709 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.708901 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.709074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.709225 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.709390 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.709541 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.709697 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.709848 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.709848 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.710136 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.710297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.710466 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.710699 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.710862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.711024 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.711181 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.711570 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.711738 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.711889 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.711889 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.711889 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.712326 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.712484 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.712829 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.712829 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.713141 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.713364 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.713516 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.713675 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.713826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.713975 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.714124 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.714282 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.714433 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.715115 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.715364 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.715752 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.715925 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.716084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.716246 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.716396 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.716552 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.716710 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.717006 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.717173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.717341 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.717603 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.717760 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.717911 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.718071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.718229 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.718387 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.718556 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.718715 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.718867 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.719032 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.719190 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.719340 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.719489 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.719639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.719795 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.720031 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.720031 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.720326 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.720495 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.720645 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.720953 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.721119 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.721277 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.721428 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.721747 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.721904 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.722069 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.722229 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.722379 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.722379 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.722670 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.722832 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.722997 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.723158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.723158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.723442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.723590 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.723739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.723920 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.724200 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.724371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.724524 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.724681 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.724874 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.725049 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.725217 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.725471 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.725640 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.725801 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.725966 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.726126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.726285 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.726434 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.726603 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.726857 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.727027 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.727186 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.727348 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.727497 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.727647 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.727647 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.728055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.728219 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.728378 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.728529 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.728686 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.728902 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.729059 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.729224 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.729397 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.729548 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.729698 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.729862 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.730020 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.730233 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.730913 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.731155 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.731155 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.731477 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.731634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.731960 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.732133 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.732133 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.732444 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.732615 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.732615 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.732615 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.733090 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.733090 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.733397 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.733706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.734081 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.734465 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.734627 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.734855 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.735048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.735240 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.735402 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.735559 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.735752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.735914 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.736119 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.736283 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.736461 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.736623 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.736853 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.737030 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.737214 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.737371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.737535 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.737699 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.737862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.738053 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.738320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.738491 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.738657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.738829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.738987 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.739142 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.739297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.739473 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.739630 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.739804 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.739961 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.740125 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.740291 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.740447 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.740616 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.740800 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.740966 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.741153 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.741394 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.741563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.741746 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.742093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.742261 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.742418 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.742583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.742748 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.742916 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.743073 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.743237 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.743449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.743611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.743782 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.743952 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.744108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.744271 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.744436 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.744592 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.744761 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.744954 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.745122 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.745122 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.745431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.745594 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.745802 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.746077 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.746244 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.746409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.746566 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.746738 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.746895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.747059 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.747059 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.747452 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.747622 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.747794 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.747952 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.748116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.748311 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.748311 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.748725 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.748942 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.749109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.749268 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.749433 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.749590 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.749759 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.749916 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.750073 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.750229 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.750399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.750563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.750729 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.750886 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.751042 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.751205 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.751205 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.751630 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.751630 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.751942 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.752276 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.752444 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.752615 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.752803 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.752967 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.753124 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.753280 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.753436 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.753610 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.753776 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.753932 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.754088 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.754254 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.754419 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.754587 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.754744 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.754918 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.755075 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.755238 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.755409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.755567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.755723 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.755885 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.756048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.756048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.756363 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.756527 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.756684 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.756896 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.757065 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.757222 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.757401 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.757559 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.757716 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.757716 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.758019 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.758177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.758342 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.758506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.758777 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.758777 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.759112 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.759279 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.759435 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.759600 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.759766 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.759924 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.760079 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.760249 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.760406 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.760569 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.760727 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.760919 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.761086 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.761272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.761462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.761727 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.761900 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.762058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.762058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.762527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.762698 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.762856 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.763013 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.763169 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.763335 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.763335 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.763652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.763816 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.763973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.764137 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.764307 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.764471 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.764636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.764872 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.765045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.765210 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.765381 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.765539 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.765713 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.765872 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.765973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766169 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766253 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766344 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766432 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766526 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766629 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766726 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766815 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766815 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766815 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.766815 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.767121 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.767211 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.767211 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.767562 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.767820 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.767938 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.768180 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.768389 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.768485 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.768857 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.769022 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.769196 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.769499 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.769693 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.769815 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.770130 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.770297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.770479 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.770797 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.770955 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.771343 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.771447 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.771682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.771972 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.772070 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.772331 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.772581 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.772692 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.772985 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.773208 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.773314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.773589 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.773809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.773904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.774214 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.774409 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.774514 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.774825 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.775053 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.775161 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.775438 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.775596 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.775749 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.776062 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.776157 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.776373 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.776685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.776804 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.777534 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.777842 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.777971 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.778205 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.778443 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.778543 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.778777 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.779053 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.779169 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.779421 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.779742 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.780055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.780151 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.780375 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.780672 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.780809 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.781029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.781311 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.781449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.781638 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.781926 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.782053 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.782274 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.782606 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.782737 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.782900 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.783143 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.783302 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.783617 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.783713 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.783936 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.784233 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.784339 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.784557 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.784855 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.784956 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.785222 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.785451 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.785563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.785841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.786071 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.786175 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.786470 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.786667 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.786812 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.787247 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.787365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.787459 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.787745 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.787855 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.788053 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.788360 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.788469 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.788668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.788970 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.789108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.789312 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.789566 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.789664 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.789904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.790157 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.790264 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.790504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.790758 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.790854 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.791132 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.791349 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.791469 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.791699 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.791997 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.792107 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.792292 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.792554 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.792718 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.793008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.793260 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.793369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.793563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.793874 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.793970 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.794179 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.794461 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.794558 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.794778 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.795054 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.795151 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.795378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.795648 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.795753 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.796027 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.796344 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.796447 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.796666 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.796983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.797083 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.809887 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.810531 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.810643 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.810738 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.810828 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.810932 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.811024 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.811122 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.811235 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.811342 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.811446 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.811546 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.811645 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.811741 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.811838 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.811838 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.812010 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.812109 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.812207 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.812297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.812384 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.812478 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.812582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.812672 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.812767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.812767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.812949 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.813049 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.813150 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.813150 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.813320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.813417 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.813514 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.813603 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.813700 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.813790 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.813884 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.813981 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.814076 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.814166 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.814261 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.814352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.814448 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.814544 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.814633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.814735 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.814824 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.814919 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.815015 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.815104 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.815104 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.815277 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.815368 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.815463 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.815560 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.815656 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.815746 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.815746 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.815924 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.816020 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.816115 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.816205 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.816302 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.816393 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.816490 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.816580 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.816675 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.817265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.817394 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.817497 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.817588 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.817677 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.817774 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.817872 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.817972 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.818063 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.818063 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.818240 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.818330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.818330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.818330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.818330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:36:20.818737 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.818737 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.818737 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.818737 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.818737 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.820177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.820177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.820177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.820545 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.821040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.821473 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.821916 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.822352 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.822782 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.823210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.823663 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.824216 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.824770 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.825237 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.825671 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.826130 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.826525 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.827144 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.827844 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.828105 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.828539 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.829017 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.829676 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.829878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.830321 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.830754 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.831188 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.831610 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.832037 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.832508 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.832965 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.833425 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.834112 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.835232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.835740 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.836108 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.836457 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.836815 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.837173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.837516 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.837837 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.838157 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.838482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.838801 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.839120 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.839436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.840302 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.840619 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.840965 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.841280 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.841624 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.841939 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.842273 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.842594 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.842910 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.843224 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.843538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.843896 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.844213 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.844558 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.844914 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.845249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.845587 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.845905 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.846239 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.846564 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.846888 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.847212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.847536 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.847862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.848187 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.848512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.848886 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.849213 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.849537 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.849863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.850451 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.850792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.851115 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.851442 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.851769 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.852089 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.852411 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.852730 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.853088 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.853406 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.853724 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.854065 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.854394 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.854728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.855072 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.855661 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.855998 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.856490 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.856841 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.857223 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.857552 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.857853 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.858179 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.858555 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.858828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.859149 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.859469 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.859872 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.860114 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.860662 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.860983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.861161 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.861731 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.862084 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.862439 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.862773 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.863242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.863415 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.863732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.864323 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.864648 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.865021 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.865357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.865690 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.866019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.866347 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.866684 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.866999 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.867312 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.867635 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.867951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.868262 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.868590 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.868938 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.869256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.869582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.869899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.870484 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.871392 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.871874 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.872216 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.872556 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.872909 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.873242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.873566 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.873877 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.874191 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.874517 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.874838 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.875151 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.875463 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.875782 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.876100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.876413 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.876732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.877071 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.877406 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.877719 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.878029 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.878339 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.878656 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.878967 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.879276 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.879591 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.879900 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.880223 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.880534 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.880875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.881188 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.881509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.881821 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.882138 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.882507 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.882844 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.883157 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.883470 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.883804 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.884120 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.884451 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.884772 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.885116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.885481 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.885803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.886400 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.887343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.887674 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.888025 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.888366 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.888683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.889026 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.889341 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.889674 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.889993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.890311 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.890630 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.890951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.891269 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.891587 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.891907 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.892226 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.892550 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.892890 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.893209 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.893528 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.893845 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.894170 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.894524 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.894850 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.895177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.895501 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.895828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.896146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.896461 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.896792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.897118 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.897440 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.897780 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.898103 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.898417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.898860 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.899183 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.899509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.899840 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.900159 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.900489 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.900839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.901163 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.901492 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.901810 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.902194 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.902552 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.902889 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.903220 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.903535 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.903846 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.904157 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.904474 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.904818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.905137 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.905449 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.905760 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.906075 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.906386 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.906699 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.907008 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.907316 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.907630 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.907940 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.908250 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.908560 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.908935 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.909247 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.909556 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.909871 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.910181 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.910490 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.910800 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.911109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.911418 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.911756 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.912094 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.912421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.912749 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.913091 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.913422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.913737 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.914064 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.914392 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.914716 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.915032 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.915371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.915688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.916006 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.916323 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.916641 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.916983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.917685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.918043 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.918373 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.918688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.919024 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.919351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.919681 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.920005 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.920326 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.920663 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.921006 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.921329 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.921647 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.921964 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.922282 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.922611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.922928 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.923246 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.923570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.923904 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.924239 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.924574 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.924923 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.925260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.925594 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.925951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.926272 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.926632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.926972 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.927292 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.927611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.927929 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:36:20.928175 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:36:20.963599 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO dbcounter [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] Registered counter for database nova_api Jul 25 05:36:20.985450 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_db.sqlalchemy.engines [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:36:20.992733 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writer thread running {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:36:21.052883 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.context [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0027c59-0b1b-4d95-bca5-9cf989836553(cell1) {{(pid=124466) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:36:21.056985 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:36:21.059014 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:36:21.060087 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:36:21.062119 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:36:21.064091 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO dbcounter [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] Registered counter for database nova_cell0 Jul 25 05:36:21.068093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO dbcounter [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] Registered counter for database nova_cell1 Jul 25 05:36:21.076368 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_db.sqlalchemy.engines [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:36:21.078466 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_db.sqlalchemy.engines [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:36:21.085331 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO dbcounter [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] Registered counter for database nova_api Jul 25 05:36:21.085462 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writer thread running {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:36:21.085672 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writer thread running {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:36:21.106057 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_db.sqlalchemy.engines [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:36:21.112707 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writer thread running {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:36:21.169801 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.context [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0027c59-0b1b-4d95-bca5-9cf989836553(cell1) {{(pid=124467) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:36:21.173912 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:36:21.175527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:36:21.176350 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:36:21.178367 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:36:21.180404 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO dbcounter [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] Registered counter for database nova_cell0 Jul 25 05:36:21.184578 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO dbcounter [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] Registered counter for database nova_cell1 Jul 25 05:36:21.192001 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_db.sqlalchemy.engines [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:36:21.193865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_db.sqlalchemy.engines [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:36:21.199878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writer thread running {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:36:21.232074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO dbcounter [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] Registered counter for database nova_cell0 Jul 25 05:36:21.238592 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_db.sqlalchemy.engines [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:36:21.243054 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writer thread running {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:36:21.341824 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writer thread running {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:36:21.351978 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO dbcounter [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] Registered counter for database nova_cell0 Jul 25 05:36:21.358715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_db.sqlalchemy.engines [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:36:21.365768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writer thread running {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:36:21.564737 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: WARNING keystonemiddleware.auth_token [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:36:21.572440 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: WARNING keystonemiddleware.auth_token [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:36:21.688443 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: WARNING keystonemiddleware.auth_token [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:36:21.696435 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: WARNING keystonemiddleware.auth_token [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:36:21.913211 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: WARNING keystonemiddleware.auth_token [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:36:21.920158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: WARNING keystonemiddleware.auth_token [None req-392d83ff-8455-4861-8d3a-6bf3ab205036 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:36:21.926681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5634697c19c0 pid: 124466 (default app) Jul 25 05:36:22.039709 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: WARNING keystonemiddleware.auth_token [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:36:22.046592 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: WARNING keystonemiddleware.auth_token [None req-b990c6d7-4528-415f-bdb9-ace7a1fa6053 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:36:22.052843 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634697c19c0 pid: 124467 (default app) Jul 25 05:37:03.002535 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:03.004646 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:03.005788 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:03.007114 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:03.213561 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=3 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:03.214441 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=3 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:03.219165 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=3 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:03.219962 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=3 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:04.655564 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d24479bc-293a-49b4-a9aa-dedc4ace4442 tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Action: 'create', calling method: .version_select at 0x7fcc863b4d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-309450979", "metadata": {"Type": "work"}}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:04.899136 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3d032ddf-24a9-42c5-bb22-60f1b4f4a417 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Action: 'create', calling method: .version_select at 0x7fcc86345ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1511258875"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:06.909097 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d24479bc-293a-49b4-a9aa-dedc4ace4442 tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.926758 Jul 25 05:37:06.909885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jul 25 05:37:02 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3930 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 05:37:06.926150 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e589f680-daeb-4f99-8549-532bb6932dc0 tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Calling method '.version_select at 0x7fcc86208b80>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:07.062489 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3d032ddf-24a9-42c5-bb22-60f1b4f4a417 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.860180 Jul 25 05:37:07.063579 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 1/2] 10.222.0.33 () {60 vars in 1154 bytes} [Mon Jul 25 05:37:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3863 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 05:37:07.088382 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3c025465-ee14-4e17-b821-8391f0b0dc22 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc8620eaf0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:07.156566 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e589f680-daeb-4f99-8549-532bb6932dc0 tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07" status: 200 len: 352 microversion: 2.1 time: 0.237725 Jul 25 05:37:07.157483 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:06 2022] GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07 => generated 352 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:07.249612 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3c025465-ee14-4e17-b821-8391f0b0dc22 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355" status: 200 len: 345 microversion: 2.1 time: 0.177223 Jul 25 05:37:07.250456 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:07 2022] GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 => generated 345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:08.170666 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-63be36ab-e132-480d-8690-3f506e6170b4 tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Calling method '.version_select at 0x7fcc86208dc0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:08.263724 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9f617656-f0c4-4a53-8da5-521deb27dbfe tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc8620ec10>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:08.341629 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-63be36ab-e132-480d-8690-3f506e6170b4 tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07" status: 200 len: 353 microversion: 2.1 time: 0.176415 Jul 25 05:37:08.341629 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 3/5] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:08 2022] GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07 => generated 353 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:08.355456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c9e66ac2-184c-4314-b9ff-a555548e47b0 tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Calling method '.version_select at 0x7fcc8622c310>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:08.404002 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-9f617656-f0c4-4a53-8da5-521deb27dbfe tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355" status: 200 len: 346 microversion: 2.1 time: 0.142110 Jul 25 05:37:08.404002 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 3/6] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:08 2022] GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 => generated 346 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:08.414876 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cd057973-8b8b-4c95-8759-15ea78d97f69 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Action: 'create', calling method: .version_select at 0x7fcc8622b1f0>, body: {"snapshot": {"volume_id": "69592ac9-3202-44f2-b92a-13a5be647355", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1034776776"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:08.900513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c9e66ac2-184c-4314-b9ff-a555548e47b0 tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07" status: 200 len: 353 microversion: 2.1 time: 0.551442 Jul 25 05:37:08.902160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:08 2022] GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07 => generated 353 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:37:08.914671 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-85db0aaa-c610-484a-9ca4-5a14bf49e3bf tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Calling method '.version_select at 0x7fcc8622c9d0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:09.255044 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cd057973-8b8b-4c95-8759-15ea78d97f69 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.845084 Jul 25 05:37:09.255946 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 4/8] 10.222.0.33 () {60 vars in 1161 bytes} [Mon Jul 25 05:37:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:37:09.266601 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-34377e4b-912f-4e0f-a6c5-043415d35792 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc8622be50>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:09.434531 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-85db0aaa-c610-484a-9ca4-5a14bf49e3bf tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07" status: 202 len: 0 microversion: 2.1 time: 0.524719 Jul 25 05:37:09.435235 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 5/9] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 25 05:37:08 2022] DELETE /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 05:37:09.443476 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b624efff-2ab9-4a2b-9b48-327b608931cf tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Calling method '.version_select at 0x7fcc8622caf0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:09.503666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-34377e4b-912f-4e0f-a6c5-043415d35792 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f" status: 200 len: 287 microversion: 2.1 time: 0.241203 Jul 25 05:37:09.504640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 5/10] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 25 05:37:09 2022] GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f => generated 287 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:09.514558 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-856f2c05-284f-48b4-bef9-3709213a2663 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc8622bca0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:09.626510 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b624efff-2ab9-4a2b-9b48-327b608931cf tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07" status: 200 len: 352 microversion: 2.1 time: 0.187066 Jul 25 05:37:09.627099 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 6/11] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:09 2022] GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07 => generated 352 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:37:09.763846 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-856f2c05-284f-48b4-bef9-3709213a2663 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.253817 Jul 25 05:37:09.764661 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1139 bytes} [Mon Jul 25 05:37:09 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:37:09.775811 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-07026368-1dbc-404e-acf8-bf44ca6736d5 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc8622c550>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:09.876342 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-07026368-1dbc-404e-acf8-bf44ca6736d5 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f" status: 200 len: 287 microversion: 2.1 time: 0.104789 Jul 25 05:37:09.877901 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 25 05:37:09 2022] GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:10.639854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-67550368-cdfb-417e-9b7b-449655754e23 tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Calling method '.version_select at 0x7fcc8620e8b0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:10.711828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-67550368-cdfb-417e-9b7b-449655754e23 tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07" status: 200 len: 352 microversion: 2.1 time: 0.076775 Jul 25 05:37:10.712400 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 7/14] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:10 2022] GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07 => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:10.889424 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7fdadd45-8b73-4a96-a737-29ffa3ac188f tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc86235160>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:10.965762 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-788854990", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:11.107915 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7fdadd45-8b73-4a96-a737-29ffa3ac188f tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f" status: 200 len: 287 microversion: 2.1 time: 0.223629 Jul 25 05:37:11.108473 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 8/15] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 25 05:37:10 2022] GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f => generated 287 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:37:11.193843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] validate_networks() for [('0be019a4-499c-47a6-88b3-5437178c588d', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:37:11.726683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5292a758-05c6-43fe-9b42-d34d837c94ad tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Calling method '.version_select at 0x7fcc8620ea60>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:11.900852 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5292a758-05c6-43fe-9b42-d34d837c94ad tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07" status: 200 len: 352 microversion: 2.1 time: 0.179689 Jul 25 05:37:11.906440 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 9/16] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:11 2022] GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07 => generated 352 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:12.121531 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-09ac32e0-cbcd-4ebf-992e-18e2c9495c14 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc8622b4c0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:12.192510 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-09ac32e0-cbcd-4ebf-992e-18e2c9495c14 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f" status: 200 len: 287 microversion: 2.1 time: 0.076662 Jul 25 05:37:12.192963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 10/17] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 25 05:37:12 2022] GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:37:12.849213 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:37:12.850445 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:37:12.851383 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:37:12.851968 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:37:12.852820 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:37:12.884579 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:12.885521 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:12.886890 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:12.887672 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:12.916107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4606f5ff-277c-4f5a-9d67-f24727da914c tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Calling method '.version_select at 0x7fcc8622b940>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:12.969138 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Getting quotas for project c782b01e8e484fe8bb710aeddc0192d1. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:37:12.976564 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Getting quotas for user 37c1bb8500f74013b073febfc0d96217 and project c782b01e8e484fe8bb710aeddc0192d1. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:37:12.991588 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:37:12.995769 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:37:13.008987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4606f5ff-277c-4f5a-9d67-f24727da914c tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07" status: 200 len: 352 microversion: 2.1 time: 0.099607 Jul 25 05:37:13.016436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 11/18] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:12 2022] GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07 => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:13.100290 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c150d038-1d0a-46b4-b556-740bbf48a8db tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.407490 Jul 25 05:37:13.101688 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 8/19] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:37:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:37:13.112351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-933041fc-99d6-46b5-91fc-166d7936104f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:13.113394 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-933041fc-99d6-46b5-91fc-166d7936104f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:13.209710 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-25aa2076-b33a-4ccb-bc0e-66fcecee5ae7 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc8612c700>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:13.322097 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-25aa2076-b33a-4ccb-bc0e-66fcecee5ae7 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f" status: 200 len: 288 microversion: 2.1 time: 0.119168 Jul 25 05:37:13.329504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 9/20] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 25 05:37:13 2022] GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f => generated 288 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:13.334708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-99b612da-e83a-460a-9374-c74551cf59a5 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc8612ce50>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:13.388111 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-933041fc-99d6-46b5-91fc-166d7936104f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:13.440364 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-933041fc-99d6-46b5-91fc-166d7936104f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1221 microversion: 2.1 time: 0.329153 Jul 25 05:37:13.442057 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 12/21] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:13 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1221 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:13.510493 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-99b612da-e83a-460a-9374-c74551cf59a5 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f" status: 202 len: 0 microversion: 2.1 time: 0.178647 Jul 25 05:37:13.511316 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 10/22] 10.222.0.33 () {58 vars in 1253 bytes} [Mon Jul 25 05:37:13 2022] DELETE /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:37:13.519718 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6436933e-532f-40a3-9a62-767bbcd0cd07 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc86235c10>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:13.573940 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6436933e-532f-40a3-9a62-767bbcd0cd07 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f" status: 200 len: 287 microversion: 2.1 time: 0.057157 Jul 25 05:37:13.574542 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 13/23] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 25 05:37:13 2022] GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:37:13.752754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1569131684", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:13.875339 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] validate_networks() for [('0be019a4-499c-47a6-88b3-5437178c588d', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:37:14.026775 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f43558f4-dcf1-41e3-9cd3-32becde9ff9e tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Calling method '.version_select at 0x7fcc861f8820>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:14.087750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-f43558f4-dcf1-41e3-9cd3-32becde9ff9e tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] HTTP exception thrown: Volume f298ecfe-6ae3-4644-a75a-610e9d5ece07 could not be found. Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f43558f4-dcf1-41e3-9cd3-32becde9ff9e tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Request method failure captured: Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07 HTTP/1.1 Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iv-FDlO5ivkT9T5izfLMbNmz2U7caktdhCcqpaA3ZTxTMvclllX5vVU376mWlvtNrb3-6thqkvWBhHWAzhAJEVFZPQe67QzlFiYN1F0JjXZ29d5jCaIWeVrYb0PiYU5CUxIz38uZQyE2tHZoTV-0a0TdDwjlPGDeIAARjqyQrIYpIM Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 129b404cb6484de8962c1aa49e34cca1 Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-VolumesGetTestJSON-167398931 Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:37:14.093074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/129b404cb6484de8962c1aa49e34cca1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/129b404cb6484de8962c1aa49e34cca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/129b404cb6484de8962c1aa49e34cca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_129b404cb6484de8962c1aa49e34cca1"}]}] Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-VolumesGetTestJSON-167398931 Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 129b404cb6484de8962c1aa49e34cca1 Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-VolumesGetTestJSON-167398931 Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-VolumesGetTestJSON-167398931-project Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 316fd0c7342946638423ecfc7a506dfb Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-VolumesGetTestJSON-167398931-project Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Volume f298ecfe-6ae3-4644-a75a-610e9d5ece07 could not be found. Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': 'f298ecfe-6ae3-4644-a75a-610e9d5ece07'} Jul 25 05:37:14.094107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f298ecfe-6ae3-4644-a75a-610e9d5ece07 could not be found. (HTTP 404) (Request-ID: req-895dab0a-4d4f-4e4d-9806-8cca8b1aef08) Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:14.094803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:37:14.096051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f298ecfe-6ae3-4644-a75a-610e9d5ece07 could not be found. Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 05:37:14.096973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f298ecfe-6ae3-4644-a75a-610e9d5ece07 could not be found. Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f298ecfe-6ae3-4644-a75a-610e9d5ece07 could not be found. Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f43558f4-dcf1-41e3-9cd3-32becde9ff9e tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] Returning 404 to user: Volume f298ecfe-6ae3-4644-a75a-610e9d5ece07 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f43558f4-dcf1-41e3-9cd3-32becde9ff9e tempest-VolumesGetTestJSON-167398931 tempest-VolumesGetTestJSON-167398931-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07" status: 404 len: 109 microversion: 2.1 time: 0.072490 Jul 25 05:37:14.098687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 14/24] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:14 2022] GET /compute/v2.1/os-volumes/f298ecfe-6ae3-4644-a75a-610e9d5ece07 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:37:14.586940 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cc9033f8-c64a-4fe2-b0f4-5bdd15415741 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc861458b0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:14.661366 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-cc9033f8-c64a-4fe2-b0f4-5bdd15415741 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] HTTP exception thrown: Snapshot 97c3136f-63b5-47af-b218-234e5518c43f could not be found. Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cc9033f8-c64a-4fe2-b0f4-5bdd15415741 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Request method failure captured: Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f HTTP/1.1 Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iv_52aPokp2jqpw02MGIuuv4FDZoMhhr_4xny5ogAdwKSA8sjOQaGCt_iyDMbrR3meKsvAzu-e65LtAtg8Y30CKa6BYtQK2NA0Js6f2zNpB5nFeMiJPY9QPvoZaSd3vDQIDrSdPBf-CkfD-sJgxV9GkkGxAF314yr0mZMl1saYBht0 Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: aa82c2fa3dea499a8b5f1e7d5fcd8acd Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:37:14.663751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}] Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: aa82c2fa3dea499a8b5f1e7d5fcd8acd Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-VolumesSnapshotsTestJSON-479969717-project Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: da3b4bd3f89842c7af66f9761ba87116 Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-VolumesSnapshotsTestJSON-479969717-project Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Snapshot 97c3136f-63b5-47af-b218-234e5518c43f could not be found. Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '97c3136f-63b5-47af-b218-234e5518c43f'} Jul 25 05:37:14.665019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 97c3136f-63b5-47af-b218-234e5518c43f could not be found. (HTTP 404) (Request-ID: req-49af9f73-f823-4c5c-89d1-942a7099a081) Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.666255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:37:14.667320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 97c3136f-63b5-47af-b218-234e5518c43f could not be found. Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 05:37:14.668301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 97c3136f-63b5-47af-b218-234e5518c43f could not be found. Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 97c3136f-63b5-47af-b218-234e5518c43f could not be found. Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cc9033f8-c64a-4fe2-b0f4-5bdd15415741 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Returning 404 to user: Snapshot 97c3136f-63b5-47af-b218-234e5518c43f could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cc9033f8-c64a-4fe2-b0f4-5bdd15415741 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f" status: 404 len: 111 microversion: 2.1 time: 0.083436 Jul 25 05:37:14.669288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 15/25] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 25 05:37:14 2022] GET /compute/v2.1/os-snapshots/97c3136f-63b5-47af-b218-234e5518c43f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:37:14.675516 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e0ec885e-5e34-4afd-99db-0a0a8957109e tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc86145670>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:14.894349 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e0ec885e-5e34-4afd-99db-0a0a8957109e tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355" status: 202 len: 0 microversion: 2.1 time: 0.222909 Jul 25 05:37:14.898509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 16/26] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 25 05:37:14 2022] DELETE /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:37:14.905840 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-09801dea-05ed-490a-98ff-fd212f0d83ff tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc8616b280>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:15.021734 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:37:15.022163 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:37:15.022469 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:37:15.023047 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:37:15.023623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:37:15.038496 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:15.038953 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:15.039770 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:15.040232 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:15.084173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-09801dea-05ed-490a-98ff-fd212f0d83ff tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355" status: 200 len: 345 microversion: 2.1 time: 0.182530 Jul 25 05:37:15.086645 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 17/27] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:14 2022] GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 => generated 345 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:37:15.105878 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Getting quotas for project c782b01e8e484fe8bb710aeddc0192d1. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:37:15.125683 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Getting quotas for user 37c1bb8500f74013b073febfc0d96217 and project c782b01e8e484fe8bb710aeddc0192d1. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:37:15.157123 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:37:15.161952 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:37:15.327110 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-00136d4c-a2c8-4c4c-94b7-82c02c8ad791 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.589923 Jul 25 05:37:15.333150 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 11/28] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:37:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:37:15.344262 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2dd9c3c6-76fe-4966-b178-f0ce825b52c8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:15.344923 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2dd9c3c6-76fe-4966-b178-f0ce825b52c8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:15.500708 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2dd9c3c6-76fe-4966-b178-f0ce825b52c8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:15.508143 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2dd9c3c6-76fe-4966-b178-f0ce825b52c8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1222 microversion: 2.1 time: 0.167648 Jul 25 05:37:15.522198 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 18/29] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:15 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1222 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:16.101896 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-782756aa-eb54-43ec-a4b6-df200fa38541 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc8612c940>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:16.232481 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-782756aa-eb54-43ec-a4b6-df200fa38541 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355" status: 200 len: 345 microversion: 2.1 time: 0.132893 Jul 25 05:37:16.234019 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 12/30] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:16 2022] GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:16.525593 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3031ba62-0ebb-4631-a613-0221c1941bb1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:16.526987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3031ba62-0ebb-4631-a613-0221c1941bb1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:16.540875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3031ba62-0ebb-4631-a613-0221c1941bb1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:16.541604 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3031ba62-0ebb-4631-a613-0221c1941bb1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:16.543110 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3031ba62-0ebb-4631-a613-0221c1941bb1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:16.543906 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3031ba62-0ebb-4631-a613-0221c1941bb1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:16.837561 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3031ba62-0ebb-4631-a613-0221c1941bb1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:16.851925 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3031ba62-0ebb-4631-a613-0221c1941bb1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1226 microversion: 2.1 time: 0.329959 Jul 25 05:37:16.866758 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 19/31] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:16 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1226 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:17.246412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8f424d29-80af-4e9a-9d55-9321f0a63258 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc860dc790>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:17.323017 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8f424d29-80af-4e9a-9d55-9321f0a63258 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355" status: 200 len: 345 microversion: 2.1 time: 0.081012 Jul 25 05:37:17.325282 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 20/32] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:17 2022] GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:37:17.716269 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1716480572", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "networks": [{"uuid": "e91b8e22-113d-4896-9773-135ebb821377"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:17.871521 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-28b59ea7-9b89-4f05-8eea-ff2142dbc27b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:17.872188 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-28b59ea7-9b89-4f05-8eea-ff2142dbc27b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:17.891176 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-28b59ea7-9b89-4f05-8eea-ff2142dbc27b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:17.891771 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-28b59ea7-9b89-4f05-8eea-ff2142dbc27b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:17.892398 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-28b59ea7-9b89-4f05-8eea-ff2142dbc27b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:17.892870 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-28b59ea7-9b89-4f05-8eea-ff2142dbc27b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:17.903873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] validate_networks() for [('e91b8e22-113d-4896-9773-135ebb821377', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:37:18.196171 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-28b59ea7-9b89-4f05-8eea-ff2142dbc27b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:18.215078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-28b59ea7-9b89-4f05-8eea-ff2142dbc27b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1226 microversion: 2.1 time: 0.348997 Jul 25 05:37:18.222911 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 21/33] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:17 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1226 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:18.337619 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d8522850-a356-430e-b9b6-befb5b34aa35 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc86145550>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:18.406075 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-d8522850-a356-430e-b9b6-befb5b34aa35 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] HTTP exception thrown: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d8522850-a356-430e-b9b6-befb5b34aa35 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Request method failure captured: Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 HTTP/1.1 Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iv_52aPokp2jqpw02MGIuuv4FDZoMhhr_4xny5ogAdwKSA8sjOQaGCt_iyDMbrR3meKsvAzu-e65LtAtg8Y30CKa6BYtQK2NA0Js6f2zNpB5nFeMiJPY9QPvoZaSd3vDQIDrSdPBf-CkfD-sJgxV9GkkGxAF314yr0mZMl1saYBht0 Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: aa82c2fa3dea499a8b5f1e7d5fcd8acd Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:37:18.407993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}] Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: aa82c2fa3dea499a8b5f1e7d5fcd8acd Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-VolumesSnapshotsTestJSON-479969717-project Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: da3b4bd3f89842c7af66f9761ba87116 Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-VolumesSnapshotsTestJSON-479969717-project Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '69592ac9-3202-44f2-b92a-13a5be647355'} Jul 25 05:37:18.409153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. (HTTP 404) (Request-ID: req-bcc1fd78-fe45-4087-a545-09aded39cfdc) Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:18.409818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:37:18.410721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 05:37:18.411613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d8522850-a356-430e-b9b6-befb5b34aa35 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Returning 404 to user: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:37:18.414549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d8522850-a356-430e-b9b6-befb5b34aa35 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355" status: 404 len: 109 microversion: 2.1 time: 0.080579 Jul 25 05:37:18.416432 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 22/34] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:18 2022] GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 05:37:18.437046 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d9029211-cd17-45a1-ab7b-b4fba7827ada tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc860e71f0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:18.488869 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-d9029211-cd17-45a1-ab7b-b4fba7827ada tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] HTTP exception thrown: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d9029211-cd17-45a1-ab7b-b4fba7827ada tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Request method failure captured: Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: DELETE /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 HTTP/1.1 Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iv_52aPokp2jqpw02MGIuuv4FDZoMhhr_4xny5ogAdwKSA8sjOQaGCt_iyDMbrR3meKsvAzu-e65LtAtg8Y30CKa6BYtQK2NA0Js6f2zNpB5nFeMiJPY9QPvoZaSd3vDQIDrSdPBf-CkfD-sJgxV9GkkGxAF314yr0mZMl1saYBht0 Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: aa82c2fa3dea499a8b5f1e7d5fcd8acd Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:37:18.492678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}] Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: aa82c2fa3dea499a8b5f1e7d5fcd8acd Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-VolumesSnapshotsTestJSON-479969717-project Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: da3b4bd3f89842c7af66f9761ba87116 Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-VolumesSnapshotsTestJSON-479969717-project Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '69592ac9-3202-44f2-b92a-13a5be647355'} Jul 25 05:37:18.493826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. (HTTP 404) (Request-ID: req-96ad9feb-8eb8-47e9-910e-f1d81de43c5a) Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:18.494455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:37:18.495660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 05:37:18.496582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d9029211-cd17-45a1-ab7b-b4fba7827ada tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Returning 404 to user: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d9029211-cd17-45a1-ab7b-b4fba7827ada tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355" status: 404 len: 109 microversion: 2.1 time: 0.064968 Jul 25 05:37:18.497506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 23/35] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 25 05:37:18 2022] DELETE /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:37:18.517465 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-06063138-12e6-4784-b681-e3f3044b5e20 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Calling method '.version_select at 0x7fcc86ba50d0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:18.599607 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-06063138-12e6-4784-b681-e3f3044b5e20 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] HTTP exception thrown: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-06063138-12e6-4784-b681-e3f3044b5e20 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Request method failure captured: Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 HTTP/1.1 Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iv_52aPokp2jqpw02MGIuuv4FDZoMhhr_4xny5ogAdwKSA8sjOQaGCt_iyDMbrR3meKsvAzu-e65LtAtg8Y30CKa6BYtQK2NA0Js6f2zNpB5nFeMiJPY9QPvoZaSd3vDQIDrSdPBf-CkfD-sJgxV9GkkGxAF314yr0mZMl1saYBht0 Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: aa82c2fa3dea499a8b5f1e7d5fcd8acd Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:37:18.601917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa82c2fa3dea499a8b5f1e7d5fcd8acd"}]}] Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: aa82c2fa3dea499a8b5f1e7d5fcd8acd Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-479969717 Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-VolumesSnapshotsTestJSON-479969717-project Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: da3b4bd3f89842c7af66f9761ba87116 Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-VolumesSnapshotsTestJSON-479969717-project Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '69592ac9-3202-44f2-b92a-13a5be647355'} Jul 25 05:37:18.603361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. (HTTP 404) (Request-ID: req-faf00e00-950f-4d62-a6c3-b9417a573875) Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:18.604369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:37:18.605951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 05:37:18.608744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-06063138-12e6-4784-b681-e3f3044b5e20 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] Returning 404 to user: Volume 69592ac9-3202-44f2-b92a-13a5be647355 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-06063138-12e6-4784-b681-e3f3044b5e20 tempest-VolumesSnapshotsTestJSON-479969717 tempest-VolumesSnapshotsTestJSON-479969717-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355" status: 404 len: 109 microversion: 2.1 time: 0.101229 Jul 25 05:37:18.611399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 24/36] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:18 2022] GET /compute/v2.1/os-volumes/69592ac9-3202-44f2-b92a-13a5be647355 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 05:37:19.240293 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-08f2711f-2874-4c8f-97d4-3b9404bf01e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:19.240959 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-08f2711f-2874-4c8f-97d4-3b9404bf01e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:19.254561 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-08f2711f-2874-4c8f-97d4-3b9404bf01e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:19.255017 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-08f2711f-2874-4c8f-97d4-3b9404bf01e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:19.280478 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-08f2711f-2874-4c8f-97d4-3b9404bf01e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:19.282685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-08f2711f-2874-4c8f-97d4-3b9404bf01e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:19.317091 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:37:19.317597 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:37:19.318479 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:37:19.319499 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:37:19.319930 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:37:19.343450 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:19.344076 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:19.346979 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:19.361247 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:19.434421 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Getting quotas for project 0dc32f383ef54d94aeb44d0bc3885614. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:37:19.447989 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Getting quotas for user bf61ffac0e3143f6b44971158bd7a553 and project 0dc32f383ef54d94aeb44d0bc3885614. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:37:19.495767 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:37:19.512278 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:37:19.648224 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-08f2711f-2874-4c8f-97d4-3b9404bf01e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:19.671475 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-08f2711f-2874-4c8f-97d4-3b9404bf01e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1282 microversion: 2.1 time: 0.430472 Jul 25 05:37:19.675063 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 25/37] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:19 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1282 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:19.689913 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-83732288-2345-493a-8bdc-465c1ccd6c68 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.487672 Jul 25 05:37:19.691595 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 13/38] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:37:19.715107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8efbb1d2-4848-4d14-b589-c4a71d07f7bf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:19.718939 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8efbb1d2-4848-4d14-b589-c4a71d07f7bf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:19.940417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8efbb1d2-4848-4d14-b589-c4a71d07f7bf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:19.956322 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8efbb1d2-4848-4d14-b589-c4a71d07f7bf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1215 microversion: 2.1 time: 0.239686 Jul 25 05:37:19.961366 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 26/39] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:19 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1215 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:20.691719 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1a275fbd-e5d2-448b-8dce-1c78b101881d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:20.692717 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1a275fbd-e5d2-448b-8dce-1c78b101881d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:20.719966 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a275fbd-e5d2-448b-8dce-1c78b101881d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:20.720430 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a275fbd-e5d2-448b-8dce-1c78b101881d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:20.727218 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a275fbd-e5d2-448b-8dce-1c78b101881d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:20.727927 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a275fbd-e5d2-448b-8dce-1c78b101881d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:20.979486 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6b6f2d28-1126-4fe3-a1d8-7329e84e21f6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:20.980590 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6b6f2d28-1126-4fe3-a1d8-7329e84e21f6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:20.997875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6b6f2d28-1126-4fe3-a1d8-7329e84e21f6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:21.000357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6b6f2d28-1126-4fe3-a1d8-7329e84e21f6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:21.001375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6b6f2d28-1126-4fe3-a1d8-7329e84e21f6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:21.008353 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6b6f2d28-1126-4fe3-a1d8-7329e84e21f6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:21.575640 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1a275fbd-e5d2-448b-8dce-1c78b101881d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:21.597726 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1a275fbd-e5d2-448b-8dce-1c78b101881d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1280 microversion: 2.1 time: 0.910028 Jul 25 05:37:21.613459 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 14/40] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:20 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1280 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:21.643188 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6b6f2d28-1126-4fe3-a1d8-7329e84e21f6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:21.652699 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6b6f2d28-1126-4fe3-a1d8-7329e84e21f6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1211 microversion: 2.1 time: 0.677476 Jul 25 05:37:21.661937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 27/41] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:20 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1211 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:22.615852 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-983260c9-c12f-4172-bd87-ed529bd69915 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:22.617119 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-983260c9-c12f-4172-bd87-ed529bd69915 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:22.637678 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-983260c9-c12f-4172-bd87-ed529bd69915 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:22.646112 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-983260c9-c12f-4172-bd87-ed529bd69915 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:22.659872 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-983260c9-c12f-4172-bd87-ed529bd69915 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:22.659872 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-983260c9-c12f-4172-bd87-ed529bd69915 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:22.679706 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e165f979-026f-4cf0-91d3-fdc932dc975e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:22.680986 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e165f979-026f-4cf0-91d3-fdc932dc975e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:22.702581 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e165f979-026f-4cf0-91d3-fdc932dc975e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:22.703042 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e165f979-026f-4cf0-91d3-fdc932dc975e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:22.703827 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e165f979-026f-4cf0-91d3-fdc932dc975e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:22.704531 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e165f979-026f-4cf0-91d3-fdc932dc975e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:23.173587 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-983260c9-c12f-4172-bd87-ed529bd69915 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:23.199702 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-983260c9-c12f-4172-bd87-ed529bd69915 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1280 microversion: 2.1 time: 0.584730 Jul 25 05:37:23.205352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 15/42] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:22 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1280 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:23.708129 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-61adaeee-9e21-4700-a268-d384c989d091 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] Calling method '.version_select at 0x7fcc85076a60>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:23.866639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-61adaeee-9e21-4700-a268-d384c989d091 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/e2771f96-f29e-4500-9b8d-c2eac2ab8568" status: 200 len: 350 microversion: 2.1 time: 0.165086 Jul 25 05:37:23.867214 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 16/43] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:23 2022] GET /compute/v2.1/os-volumes/e2771f96-f29e-4500-9b8d-c2eac2ab8568 => generated 350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:24.004561 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e165f979-026f-4cf0-91d3-fdc932dc975e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:24.024850 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e165f979-026f-4cf0-91d3-fdc932dc975e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1273 microversion: 2.1 time: 1.348718 Jul 25 05:37:24.050556 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 28/44] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:22 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1273 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:24.222711 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-94a32f75-9f64-41d9-9721-47de9960a122 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:24.223330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-94a32f75-9f64-41d9-9721-47de9960a122 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:24.240831 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-94a32f75-9f64-41d9-9721-47de9960a122 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:24.251119 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-94a32f75-9f64-41d9-9721-47de9960a122 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:24.252490 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-94a32f75-9f64-41d9-9721-47de9960a122 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:24.254843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-94a32f75-9f64-41d9-9721-47de9960a122 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:25.059284 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c1ac7f53-102d-42ad-9236-fda54f8f0eb3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:25.060683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c1ac7f53-102d-42ad-9236-fda54f8f0eb3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:25.066010 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-94a32f75-9f64-41d9-9721-47de9960a122 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:25.082021 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c1ac7f53-102d-42ad-9236-fda54f8f0eb3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:25.082431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c1ac7f53-102d-42ad-9236-fda54f8f0eb3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:25.084679 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-94a32f75-9f64-41d9-9721-47de9960a122 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1280 microversion: 2.1 time: 0.863111 Jul 25 05:37:25.086180 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 17/45] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:24 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1280 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:25.088229 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c1ac7f53-102d-42ad-9236-fda54f8f0eb3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:25.105676 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c1ac7f53-102d-42ad-9236-fda54f8f0eb3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:25.478593 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-c1ac7f53-102d-42ad-9236-fda54f8f0eb3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:25.501343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c1ac7f53-102d-42ad-9236-fda54f8f0eb3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1273 microversion: 2.1 time: 0.446419 Jul 25 05:37:25.504143 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 29/46] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:25 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1273 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:25.914996 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-465879af-1310-47bd-b9fb-c8d883c545b8 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] Calling method '.version_select at 0x7fcc85076c10>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:26.086697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-465879af-1310-47bd-b9fb-c8d883c545b8 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f85e8565-9c57-4463-88fb-16ea022ab590" status: 200 len: 351 microversion: 2.1 time: 0.176010 Jul 25 05:37:26.094288 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 18/47] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:25 2022] GET /compute/v2.1/os-volumes/f85e8565-9c57-4463-88fb-16ea022ab590 => generated 351 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:26.102504 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-306f1526-cd2f-4349-b19f-4cd1ae39eb39 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:26.103126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-306f1526-cd2f-4349-b19f-4cd1ae39eb39 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:26.122596 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-306f1526-cd2f-4349-b19f-4cd1ae39eb39 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:26.123059 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-306f1526-cd2f-4349-b19f-4cd1ae39eb39 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:26.123877 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-306f1526-cd2f-4349-b19f-4cd1ae39eb39 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:26.124319 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-306f1526-cd2f-4349-b19f-4cd1ae39eb39 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:26.521918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bbb3fc83-2bbd-494f-aab8-d5e0be00e71c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:26.522506 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bbb3fc83-2bbd-494f-aab8-d5e0be00e71c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:26.545330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbb3fc83-2bbd-494f-aab8-d5e0be00e71c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:26.545733 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbb3fc83-2bbd-494f-aab8-d5e0be00e71c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:26.552468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbb3fc83-2bbd-494f-aab8-d5e0be00e71c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:26.555685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbb3fc83-2bbd-494f-aab8-d5e0be00e71c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:27.404415 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-306f1526-cd2f-4349-b19f-4cd1ae39eb39 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:27.422825 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-306f1526-cd2f-4349-b19f-4cd1ae39eb39 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 1.323681 Jul 25 05:37:27.425150 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 30/48] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:26 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:28.106407 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bbb3fc83-2bbd-494f-aab8-d5e0be00e71c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:28.117925 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bbb3fc83-2bbd-494f-aab8-d5e0be00e71c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 1.597317 Jul 25 05:37:28.119031 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 19/49] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:26 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:37:28.185671 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f0ec640b-460c-47c7-9833-b905984f6ea2 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] Calling method '.version_select at 0x7fcc86041280>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:28.246525 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f0ec640b-460c-47c7-9833-b905984f6ea2 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c6a1772d-1b4c-4c8a-9b9b-5c9cb3e4131f" status: 200 len: 351 microversion: 2.1 time: 0.064640 Jul 25 05:37:28.247646 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 31/50] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:37:28 2022] GET /compute/v2.1/os-volumes/c6a1772d-1b4c-4c8a-9b9b-5c9cb3e4131f => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:28.259141 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2ccbb04b-b907-4802-a501-a1a68147fce7 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] Calling method '.version_select at 0x7fcc85076e50>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:28.439782 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-aff6e515-2891-487c-b341-048b570391c9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:28.440401 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-aff6e515-2891-487c-b341-048b570391c9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:28.447552 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aff6e515-2891-487c-b341-048b570391c9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:28.451669 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aff6e515-2891-487c-b341-048b570391c9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:28.453457 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aff6e515-2891-487c-b341-048b570391c9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:28.455300 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aff6e515-2891-487c-b341-048b570391c9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:28.491556 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2ccbb04b-b907-4802-a501-a1a68147fce7 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.236327 Jul 25 05:37:28.492525 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 20/51] 10.222.0.33 () {58 vars in 1133 bytes} [Mon Jul 25 05:37:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:28.506035 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d27d029b-863d-4782-af77-58573a6d7b21 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] Calling method '.version_select at 0x7fcc850261f0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:28.754457 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d27d029b-863d-4782-af77-58573a6d7b21 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.252440 Jul 25 05:37:28.755572 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 21/52] 10.222.0.33 () {58 vars in 1148 bytes} [Mon Jul 25 05:37:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:28.768560 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-118c0dc7-0adf-4dc3-8b90-070b9af5bf65 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] Calling method '.version_select at 0x7fcc8502e9d0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:29.071415 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-118c0dc7-0adf-4dc3-8b90-070b9af5bf65 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.307270 Jul 25 05:37:29.072840 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 22/53] 10.222.0.33 () {58 vars in 1133 bytes} [Mon Jul 25 05:37:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:29.088395 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fe62a3d2-2a78-43c4-9694-e42c0fe8b2e3 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] Calling method '.version_select at 0x7fcc8502eca0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:29.315814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fe62a3d2-2a78-43c4-9694-e42c0fe8b2e3 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.229342 Jul 25 05:37:29.325652 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 23/54] 10.222.0.33 () {58 vars in 1166 bytes} [Mon Jul 25 05:37:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:29.333405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-07e69ed7-977f-4ab4-936f-3a37b528e6d1 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:29.334060 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-07e69ed7-977f-4ab4-936f-3a37b528e6d1 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:29.352561 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07e69ed7-977f-4ab4-936f-3a37b528e6d1 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:29.354950 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07e69ed7-977f-4ab4-936f-3a37b528e6d1 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:29.358092 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07e69ed7-977f-4ab4-936f-3a37b528e6d1 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:29.359044 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07e69ed7-977f-4ab4-936f-3a37b528e6d1 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:29.450011 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=6 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:29.486827 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=18 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:29.493663 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-aff6e515-2891-487c-b341-048b570391c9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:29.503908 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-aff6e515-2891-487c-b341-048b570391c9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 1.068264 Jul 25 05:37:29.536625 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 32/55] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:28 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:37:29.549303 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-43884fa7-19a7-4156-9b49-a6fddfd9bf56 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] Calling method '.version_select at 0x7fcc860dcb80>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:29.846676 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-43884fa7-19a7-4156-9b49-a6fddfd9bf56 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.308796 Jul 25 05:37:29.847241 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 33/56] 10.222.0.33 () {58 vars in 1169 bytes} [Mon Jul 25 05:37:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:29.860676 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7728821a-2251-4d93-a282-e44a3c2b43f0 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] Calling method '.version_select at 0x7fcc86041700>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:29.949580 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=6 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:30.125720 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7728821a-2251-4d93-a282-e44a3c2b43f0 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.268921 Jul 25 05:37:30.127108 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 34/57] 10.222.0.33 () {58 vars in 1154 bytes} [Mon Jul 25 05:37:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:30.636544 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-07e69ed7-977f-4ab4-936f-3a37b528e6d1 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:30.662341 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-07e69ed7-977f-4ab4-936f-3a37b528e6d1 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 1.335424 Jul 25 05:37:30.677623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 24/58] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:29 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:30.684117 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a1fe2c44-76ab-453a-aab7-7eec063339d3 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] Calling method '.version_select at 0x7fcc8501d040>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:31.022786 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-31492dda-c7b4-475a-97d4-fb639b757533 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: .version_select at 0x7fcc86041a60>, body: {"keypair": {"name": "tempest-keypair-1921352837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLwP/9HgGa6NQ2y5QQqkRCHzv22yPg0qTrwfqIXHnyXjpJOxSBwpd17QX8tdba7uWuZ8MJGSeHE37s7U4gq1sFz+Ouxn4Ou5U2EhiCUipaW/pzCll3YH8+arcf8qJEDWQ=="}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:31.083974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a1fe2c44-76ab-453a-aab7-7eec063339d3 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.404329 Jul 25 05:37:31.085500 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 25/59] 10.222.0.33 () {58 vars in 1187 bytes} [Mon Jul 25 05:37:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:31.091159 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-53e8a95c-a558-41d7-96f9-fd29d66263a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:31.092237 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-53e8a95c-a558-41d7-96f9-fd29d66263a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:31.130071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53e8a95c-a558-41d7-96f9-fd29d66263a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:31.132000 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53e8a95c-a558-41d7-96f9-fd29d66263a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:31.142553 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53e8a95c-a558-41d7-96f9-fd29d66263a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:31.145722 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53e8a95c-a558-41d7-96f9-fd29d66263a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:31.222948 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-31492dda-c7b4-475a-97d4-fb639b757533 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:37:31.266412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-31492dda-c7b4-475a-97d4-fb639b757533 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for user 69f3276517de4f889dddd3180436ede9 and project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:37:31.475842 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-31492dda-c7b4-475a-97d4-fb639b757533 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.347380 Jul 25 05:37:31.476449 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 35/60] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 25 05:37:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:32.090563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-6014f410-8e72-48bf-950e-f7efb4ac5fa9 req-5d827dd7-98b9-4ff8-9bee-6feb7d029f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12aaf07a-d8f0-46c4-98f9-ba47ee257fa7", "tag": "6d22bdd7-e942-45f4-b095-81aa2ad4c2d4"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:32.140701 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-6014f410-8e72-48bf-950e-f7efb4ac5fa9 req-5d827dd7-98b9-4ff8-9bee-6feb7d029f9e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:32.156203 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-6014f410-8e72-48bf-950e-f7efb4ac5fa9 req-5d827dd7-98b9-4ff8-9bee-6feb7d029f9e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:32.282590 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-6014f410-8e72-48bf-950e-f7efb4ac5fa9 req-5d827dd7-98b9-4ff8-9bee-6feb7d029f9e service nova] Creating event network-changed:6d22bdd7-e942-45f4-b095-81aa2ad4c2d4 for instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 on hv-cinder-85083 Jul 25 05:37:32.287924 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-6014f410-8e72-48bf-950e-f7efb4ac5fa9 req-5d827dd7-98b9-4ff8-9bee-6feb7d029f9e service nova] Acquired lock "compute-rpcapi-router" {{(pid=124467) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 05:37:32.289777 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-36ea197f-d152-41d5-afd2-3de4d5617305 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:32.291190 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-36ea197f-d152-41d5-afd2-3de4d5617305 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:32.297329 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-36ea197f-d152-41d5-afd2-3de4d5617305 None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:32.297999 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-36ea197f-d152-41d5-afd2-3de4d5617305 None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:32.343415 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.compute.rpcapi [None req-36ea197f-d152-41d5-afd2-3de4d5617305 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 05:37:32.348538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-36ea197f-d152-41d5-afd2-3de4d5617305 None None] Releasing lock "compute-rpcapi-router" {{(pid=124467) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 05:37:32.424994 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-36ea197f-d152-41d5-afd2-3de4d5617305 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.943061 Jul 25 05:37:32.426220 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 36/61] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:32.432605 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-dcfd8da5-8406-4fb0-9118-7f08215009d4 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] Calling method '.version_select at 0x7fcc86079af0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:32.626398 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-53e8a95c-a558-41d7-96f9-fd29d66263a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:32.645275 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-53e8a95c-a558-41d7-96f9-fd29d66263a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 1.558174 Jul 25 05:37:32.645874 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 26/62] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:31 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:32.654789 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-64d9127e-94c8-4e1d-9b26-0a149714c5e2 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:32.659528 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-dcfd8da5-8406-4fb0-9118-7f08215009d4 tempest-VolumesTestJSON-1246275946 tempest-VolumesTestJSON-1246275946-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.231812 Jul 25 05:37:32.660118 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 37/63] 10.222.0.33 () {58 vars in 1154 bytes} [Mon Jul 25 05:37:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:32.665570 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-64d9127e-94c8-4e1d-9b26-0a149714c5e2 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:32.699631 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d9127e-94c8-4e1d-9b26-0a149714c5e2 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:32.701678 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d9127e-94c8-4e1d-9b26-0a149714c5e2 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:32.702543 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d9127e-94c8-4e1d-9b26-0a149714c5e2 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:32.706575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d9127e-94c8-4e1d-9b26-0a149714c5e2 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:32.971826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-614e4e32-21f4-4bd4-9b5b-b4883cf5b088 req-36ef1db1-03a4-4501-9792-de28b5475b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d49b4fd-206c-478c-9078-e3f88faedd9a", "tag": "ba399b8d-ed3f-49b4-ac2e-afa79260f403"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:32.981022 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-614e4e32-21f4-4bd4-9b5b-b4883cf5b088 req-36ef1db1-03a4-4501-9792-de28b5475b75 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:32.987781 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-614e4e32-21f4-4bd4-9b5b-b4883cf5b088 req-36ef1db1-03a4-4501-9792-de28b5475b75 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:33.016204 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-614e4e32-21f4-4bd4-9b5b-b4883cf5b088 req-36ef1db1-03a4-4501-9792-de28b5475b75 service nova] Creating event network-changed:ba399b8d-ed3f-49b4-ac2e-afa79260f403 for instance 8d49b4fd-206c-478c-9078-e3f88faedd9a on hv-cinder-85083 Jul 25 05:37:33.033969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-614e4e32-21f4-4bd4-9b5b-b4883cf5b088 req-36ef1db1-03a4-4501-9792-de28b5475b75 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372648 Jul 25 05:37:33.046489 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 38/64] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:33.664351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a6f558ae-fb1a-4496-9a68-ee0cb3124585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:33.665247 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a6f558ae-fb1a-4496-9a68-ee0cb3124585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:33.668009 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:33.680036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a6f558ae-fb1a-4496-9a68-ee0cb3124585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:33.684293 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a6f558ae-fb1a-4496-9a68-ee0cb3124585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:33.685363 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a6f558ae-fb1a-4496-9a68-ee0cb3124585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:33.685887 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a6f558ae-fb1a-4496-9a68-ee0cb3124585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:34.593962 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-64d9127e-94c8-4e1d-9b26-0a149714c5e2 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:34.603454 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=47 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:34.614641 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-64d9127e-94c8-4e1d-9b26-0a149714c5e2 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 1.964310 Jul 25 05:37:34.629674 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 27/65] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:32 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:34.737448 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a6f558ae-fb1a-4496-9a68-ee0cb3124585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:34.750178 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a6f558ae-fb1a-4496-9a68-ee0cb3124585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 1.090342 Jul 25 05:37:34.751057 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 39/66] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:33 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:35.294355 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-047a7265-b915-4f00-8d09-f268523a7828 req-cd955ace-dbc4-44a6-9dfc-d1cc5f8ff475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8106f539-061c-475e-a74f-ba331c8dc856", "tag": "36da70ce-1188-4fd6-913c-922c1c4b037b"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:35.315343 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=9 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:35.341901 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-047a7265-b915-4f00-8d09-f268523a7828 req-cd955ace-dbc4-44a6-9dfc-d1cc5f8ff475 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:35.342460 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-047a7265-b915-4f00-8d09-f268523a7828 req-cd955ace-dbc4-44a6-9dfc-d1cc5f8ff475 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:35.462088 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-047a7265-b915-4f00-8d09-f268523a7828 req-cd955ace-dbc4-44a6-9dfc-d1cc5f8ff475 service nova] Creating event network-changed:36da70ce-1188-4fd6-913c-922c1c4b037b for instance 8106f539-061c-475e-a74f-ba331c8dc856 on hv-cinder-85083 Jul 25 05:37:35.462756 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-047a7265-b915-4f00-8d09-f268523a7828 req-cd955ace-dbc4-44a6-9dfc-d1cc5f8ff475 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124466) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 05:37:35.464081 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6457a7f6-f244-47ff-a82e-d57a4e70328a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:35.464544 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6457a7f6-f244-47ff-a82e-d57a4e70328a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:35.465389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6457a7f6-f244-47ff-a82e-d57a4e70328a None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:35.465834 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6457a7f6-f244-47ff-a82e-d57a4e70328a None None] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:35.498455 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.compute.rpcapi [None req-6457a7f6-f244-47ff-a82e-d57a4e70328a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 05:37:35.499786 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6457a7f6-f244-47ff-a82e-d57a4e70328a None None] Releasing lock "compute-rpcapi-router" {{(pid=124466) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 05:37:35.555556 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6457a7f6-f244-47ff-a82e-d57a4e70328a None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263706 Jul 25 05:37:35.566452 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 28/67] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:35.642310 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-92bb4df5-4403-46dd-8d90-b5979b217dcf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:35.643349 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-92bb4df5-4403-46dd-8d90-b5979b217dcf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:35.655115 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92bb4df5-4403-46dd-8d90-b5979b217dcf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:35.656119 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92bb4df5-4403-46dd-8d90-b5979b217dcf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:35.674399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92bb4df5-4403-46dd-8d90-b5979b217dcf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:35.675618 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92bb4df5-4403-46dd-8d90-b5979b217dcf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:35.768670 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-379bdb4f-ded8-48e8-b866-e73831ddb350 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:35.770022 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-379bdb4f-ded8-48e8-b866-e73831ddb350 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:35.789998 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-379bdb4f-ded8-48e8-b866-e73831ddb350 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:35.793115 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-379bdb4f-ded8-48e8-b866-e73831ddb350 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:35.796313 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-379bdb4f-ded8-48e8-b866-e73831ddb350 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:35.799014 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-379bdb4f-ded8-48e8-b866-e73831ddb350 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:36.447798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-92bb4df5-4403-46dd-8d90-b5979b217dcf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:36.459179 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-92bb4df5-4403-46dd-8d90-b5979b217dcf tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 0.823900 Jul 25 05:37:36.461987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 40/68] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:35 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:36.663176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-379bdb4f-ded8-48e8-b866-e73831ddb350 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:36.678219 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-379bdb4f-ded8-48e8-b866-e73831ddb350 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 0.914594 Jul 25 05:37:36.679461 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 29/69] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:35 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:37:37.479858 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6843124f-2c6f-4708-9fb8-d1f7bea925bc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:37.480623 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6843124f-2c6f-4708-9fb8-d1f7bea925bc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:37.490652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6843124f-2c6f-4708-9fb8-d1f7bea925bc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:37.493098 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6843124f-2c6f-4708-9fb8-d1f7bea925bc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:37.499506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6843124f-2c6f-4708-9fb8-d1f7bea925bc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:37.502520 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6843124f-2c6f-4708-9fb8-d1f7bea925bc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:37.701538 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0e794b0c-414f-454a-9b38-d2efb3180629 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:37.703324 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0e794b0c-414f-454a-9b38-d2efb3180629 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:37.721296 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0e794b0c-414f-454a-9b38-d2efb3180629 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:37.723408 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0e794b0c-414f-454a-9b38-d2efb3180629 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:37.726302 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0e794b0c-414f-454a-9b38-d2efb3180629 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:37.727387 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0e794b0c-414f-454a-9b38-d2efb3180629 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:37.990337 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6843124f-2c6f-4708-9fb8-d1f7bea925bc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:37.998543 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6843124f-2c6f-4708-9fb8-d1f7bea925bc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 0.522823 Jul 25 05:37:38.012098 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 41/70] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:37 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:38.018188 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-914762727", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fec420c3-be12-4a0c-92d9-7ad0ead1f91c"}], "security_groups": [{"name": "tempest-securitygroup--1431156053"}], "key_name": "tempest-keypair-1921352837", "user_data": "}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:38.047735 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0e794b0c-414f-454a-9b38-d2efb3180629 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:38.057090 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0e794b0c-414f-454a-9b38-d2efb3180629 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 0.363877 Jul 25 05:37:38.057716 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 30/71] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:37 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:37:38.175068 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.network.neutron [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] validate_networks() for [('fec420c3-be12-4a0c-92d9-7ad0ead1f91c', None, None, None, None, None)] {{(pid=124467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:37:39.021155 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-903fac45-f51a-4894-aa93-491c496a65cb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:39.022301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-903fac45-f51a-4894-aa93-491c496a65cb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:39.030882 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-903fac45-f51a-4894-aa93-491c496a65cb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:39.031692 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-903fac45-f51a-4894-aa93-491c496a65cb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:39.032762 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-903fac45-f51a-4894-aa93-491c496a65cb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:39.033537 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-903fac45-f51a-4894-aa93-491c496a65cb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:39.247424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-903fac45-f51a-4894-aa93-491c496a65cb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:39.256115 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-903fac45-f51a-4894-aa93-491c496a65cb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 0.240661 Jul 25 05:37:39.258219 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 31/72] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:39 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:39.265279 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-185ddf29-1793-4573-adf4-3db3e1a40f2f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:39.266288 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-185ddf29-1793-4573-adf4-3db3e1a40f2f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:39.273374 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-185ddf29-1793-4573-adf4-3db3e1a40f2f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:39.274103 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-185ddf29-1793-4573-adf4-3db3e1a40f2f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:39.275261 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-185ddf29-1793-4573-adf4-3db3e1a40f2f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:39.275920 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-185ddf29-1793-4573-adf4-3db3e1a40f2f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:39.483649 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-185ddf29-1793-4573-adf4-3db3e1a40f2f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:39.497100 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-185ddf29-1793-4573-adf4-3db3e1a40f2f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 0.237351 Jul 25 05:37:39.507300 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 32/73] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:39 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:39.827080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Flavor limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:37:39.828733 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Image limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:37:39.829441 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Flavor pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:37:39.830240 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Image pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:37:39.830660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:37:39.840542 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:39.841026 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:39.841899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:39.842519 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:39.866396 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:37:39.870703 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for user 69f3276517de4f889dddd3180436ede9 and project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:37:39.882039 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Going to run 1 instances... {{(pid=124467) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:37:39.884743 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:37:39.954100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-386c1b2f-5780-4674-b82a-9a8bcf1a356e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.940589 Jul 25 05:37:39.961133 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 42/74] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:37:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:37:39.967264 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b390a25e-b5f5-445a-a168-eb0dcd211183 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:39.967892 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b390a25e-b5f5-445a-a168-eb0dcd211183 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:40.061285 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b390a25e-b5f5-445a-a168-eb0dcd211183 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:40.073738 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b390a25e-b5f5-445a-a168-eb0dcd211183 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1241 microversion: 2.1 time: 0.111016 Jul 25 05:37:40.074840 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 33/75] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:39 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:37:40.275431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-85f7c3ee-9f25-4d3c-b3f3-8199c6bacdee tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:40.276886 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-85f7c3ee-9f25-4d3c-b3f3-8199c6bacdee tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:40.285712 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-85f7c3ee-9f25-4d3c-b3f3-8199c6bacdee tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:40.286588 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-85f7c3ee-9f25-4d3c-b3f3-8199c6bacdee tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:40.287442 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-85f7c3ee-9f25-4d3c-b3f3-8199c6bacdee tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:40.287890 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-85f7c3ee-9f25-4d3c-b3f3-8199c6bacdee tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:40.516412 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7187e544-7a81-4e56-9d55-4f5b0ff92bb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:40.517295 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7187e544-7a81-4e56-9d55-4f5b0ff92bb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:40.530130 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7187e544-7a81-4e56-9d55-4f5b0ff92bb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:40.531522 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7187e544-7a81-4e56-9d55-4f5b0ff92bb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:40.532491 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7187e544-7a81-4e56-9d55-4f5b0ff92bb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:40.535770 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7187e544-7a81-4e56-9d55-4f5b0ff92bb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:40.561297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-85f7c3ee-9f25-4d3c-b3f3-8199c6bacdee tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:40.574117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-85f7c3ee-9f25-4d3c-b3f3-8199c6bacdee tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 0.300444 Jul 25 05:37:40.575050 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 43/76] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:40 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:40.713405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7187e544-7a81-4e56-9d55-4f5b0ff92bb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:40.721456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7187e544-7a81-4e56-9d55-4f5b0ff92bb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 0.211019 Jul 25 05:37:40.722339 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 34/77] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:40 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:41.091929 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7be22195-2a96-4ba3-a101-2184fe7cb62a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:41.092861 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7be22195-2a96-4ba3-a101-2184fe7cb62a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:41.098940 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7be22195-2a96-4ba3-a101-2184fe7cb62a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:41.099399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7be22195-2a96-4ba3-a101-2184fe7cb62a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:41.100883 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7be22195-2a96-4ba3-a101-2184fe7cb62a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:41.101332 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7be22195-2a96-4ba3-a101-2184fe7cb62a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:41.171355 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7be22195-2a96-4ba3-a101-2184fe7cb62a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:41.179002 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7be22195-2a96-4ba3-a101-2184fe7cb62a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1245 microversion: 2.1 time: 0.091426 Jul 25 05:37:41.181520 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 44/78] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:41 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:41.595517 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cd8d79ff-660f-4c6f-b217-7e1fc9643aa3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:41.596941 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cd8d79ff-660f-4c6f-b217-7e1fc9643aa3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:41.610885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cd8d79ff-660f-4c6f-b217-7e1fc9643aa3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:41.611341 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cd8d79ff-660f-4c6f-b217-7e1fc9643aa3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:41.612132 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cd8d79ff-660f-4c6f-b217-7e1fc9643aa3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:41.612584 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cd8d79ff-660f-4c6f-b217-7e1fc9643aa3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:41.740733 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-14cdb67e-c59f-49a4-a5f0-7d4d12c6c2bc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:41.742482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-14cdb67e-c59f-49a4-a5f0-7d4d12c6c2bc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:41.752562 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14cdb67e-c59f-49a4-a5f0-7d4d12c6c2bc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:41.753304 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14cdb67e-c59f-49a4-a5f0-7d4d12c6c2bc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:41.759271 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14cdb67e-c59f-49a4-a5f0-7d4d12c6c2bc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:41.759913 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14cdb67e-c59f-49a4-a5f0-7d4d12c6c2bc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:41.889030 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cd8d79ff-660f-4c6f-b217-7e1fc9643aa3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:41.903348 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cd8d79ff-660f-4c6f-b217-7e1fc9643aa3 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 0.315613 Jul 25 05:37:41.909831 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 35/79] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:41 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:41.990691 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-14cdb67e-c59f-49a4-a5f0-7d4d12c6c2bc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:42.009234 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-14cdb67e-c59f-49a4-a5f0-7d4d12c6c2bc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 0.274007 Jul 25 05:37:42.011588 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 45/80] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:41 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:42.197245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7970eb27-6da6-43b0-8208-cc5543a93bfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:42.198203 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7970eb27-6da6-43b0-8208-cc5543a93bfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:42.206906 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7970eb27-6da6-43b0-8208-cc5543a93bfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:42.207605 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7970eb27-6da6-43b0-8208-cc5543a93bfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:42.210135 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7970eb27-6da6-43b0-8208-cc5543a93bfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:42.210581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7970eb27-6da6-43b0-8208-cc5543a93bfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:42.377473 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7970eb27-6da6-43b0-8208-cc5543a93bfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:42.396640 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7970eb27-6da6-43b0-8208-cc5543a93bfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1301 microversion: 2.1 time: 0.203349 Jul 25 05:37:42.408664 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 36/81] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:42 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1301 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:42.924419 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5779ef42-8303-4ecd-b41b-5b391ed6bb99 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:42.925646 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5779ef42-8303-4ecd-b41b-5b391ed6bb99 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:42.939679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5779ef42-8303-4ecd-b41b-5b391ed6bb99 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:42.940362 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5779ef42-8303-4ecd-b41b-5b391ed6bb99 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:42.941648 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5779ef42-8303-4ecd-b41b-5b391ed6bb99 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:42.942397 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5779ef42-8303-4ecd-b41b-5b391ed6bb99 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:43.028834 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-40d04f0b-cc73-410c-99a0-e4559cfba902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:43.030696 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-40d04f0b-cc73-410c-99a0-e4559cfba902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:43.040638 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40d04f0b-cc73-410c-99a0-e4559cfba902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:43.042455 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40d04f0b-cc73-410c-99a0-e4559cfba902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:43.046114 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40d04f0b-cc73-410c-99a0-e4559cfba902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:43.047664 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40d04f0b-cc73-410c-99a0-e4559cfba902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:43.442835 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5779ef42-8303-4ecd-b41b-5b391ed6bb99 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:43.446567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=97 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:43.461461 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5779ef42-8303-4ecd-b41b-5b391ed6bb99 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 0.545625 Jul 25 05:37:43.464689 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 46/82] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:42 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:43.470943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7ba956fd-23d8-4b80-83bc-28316ac55c91 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:43.471562 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7ba956fd-23d8-4b80-83bc-28316ac55c91 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:43.493974 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7ba956fd-23d8-4b80-83bc-28316ac55c91 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:43.494729 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7ba956fd-23d8-4b80-83bc-28316ac55c91 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:43.496119 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7ba956fd-23d8-4b80-83bc-28316ac55c91 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:43.496580 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7ba956fd-23d8-4b80-83bc-28316ac55c91 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:43.598596 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-40d04f0b-cc73-410c-99a0-e4559cfba902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:43.606754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-40d04f0b-cc73-410c-99a0-e4559cfba902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 0.582574 Jul 25 05:37:43.607343 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 37/83] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:43 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:43.659897 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7ba956fd-23d8-4b80-83bc-28316ac55c91 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:43.671350 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7ba956fd-23d8-4b80-83bc-28316ac55c91 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1299 microversion: 2.1 time: 0.204643 Jul 25 05:37:43.674053 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 47/84] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:43 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1299 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:44.482585 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2c03028b-a8c0-4ecf-983c-add70e5ad8c9 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:44.483206 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2c03028b-a8c0-4ecf-983c-add70e5ad8c9 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:44.496185 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c03028b-a8c0-4ecf-983c-add70e5ad8c9 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:44.496864 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c03028b-a8c0-4ecf-983c-add70e5ad8c9 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:44.498659 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c03028b-a8c0-4ecf-983c-add70e5ad8c9 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:44.499113 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c03028b-a8c0-4ecf-983c-add70e5ad8c9 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:44.625744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-aeac863a-bb54-4fc5-afbf-850dd7c75544 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:44.629188 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-aeac863a-bb54-4fc5-afbf-850dd7c75544 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:44.645573 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeac863a-bb54-4fc5-afbf-850dd7c75544 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:44.646045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeac863a-bb54-4fc5-afbf-850dd7c75544 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:44.649136 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeac863a-bb54-4fc5-afbf-850dd7c75544 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:44.649602 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeac863a-bb54-4fc5-afbf-850dd7c75544 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:45.121800 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2c03028b-a8c0-4ecf-983c-add70e5ad8c9 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:45.132239 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-aeac863a-bb54-4fc5-afbf-850dd7c75544 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:45.137598 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2c03028b-a8c0-4ecf-983c-add70e5ad8c9 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 0.660276 Jul 25 05:37:45.138933 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 38/85] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:44 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:45.148625 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-082083ff-9d8b-46eb-bae2-69924355f892 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:45.149180 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-aeac863a-bb54-4fc5-afbf-850dd7c75544 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 0.529163 Jul 25 05:37:45.150454 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-082083ff-9d8b-46eb-bae2-69924355f892 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:45.152210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 48/86] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:44 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:37:45.159349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-082083ff-9d8b-46eb-bae2-69924355f892 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:45.159801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-082083ff-9d8b-46eb-bae2-69924355f892 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:45.160633 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-082083ff-9d8b-46eb-bae2-69924355f892 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:45.161274 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-082083ff-9d8b-46eb-bae2-69924355f892 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:45.398917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-b5fc851b-e133-4960-867b-6fa5bef56f38 req-f7314c4d-7e4b-41ef-896c-8b1433a548b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a28e80-5bf2-46af-9ece-8f7d147629fe", "tag": "96397b18-73bc-4e7f-abf2-2e7a32610b85"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:45.411889 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-b5fc851b-e133-4960-867b-6fa5bef56f38 req-f7314c4d-7e4b-41ef-896c-8b1433a548b1 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:45.412662 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-b5fc851b-e133-4960-867b-6fa5bef56f38 req-f7314c4d-7e4b-41ef-896c-8b1433a548b1 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:45.447891 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-b5fc851b-e133-4960-867b-6fa5bef56f38 req-f7314c4d-7e4b-41ef-896c-8b1433a548b1 service nova] Creating event network-changed:96397b18-73bc-4e7f-abf2-2e7a32610b85 for instance f5a28e80-5bf2-46af-9ece-8f7d147629fe on hv-cinder-85083 Jul 25 05:37:45.463306 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-b5fc851b-e133-4960-867b-6fa5bef56f38 req-f7314c4d-7e4b-41ef-896c-8b1433a548b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069503 Jul 25 05:37:45.469080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 49/87] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:45.496461 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:45.552101 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-082083ff-9d8b-46eb-bae2-69924355f892 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:45.563103 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-082083ff-9d8b-46eb-bae2-69924355f892 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1367 microversion: 2.1 time: 0.421002 Jul 25 05:37:45.564002 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 39/88] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:45 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:46.157340 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-065154f5-832c-4f1a-b19a-476b93ebd90c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:46.158211 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-065154f5-832c-4f1a-b19a-476b93ebd90c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:46.177537 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-065154f5-832c-4f1a-b19a-476b93ebd90c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:46.179379 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-065154f5-832c-4f1a-b19a-476b93ebd90c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:46.184116 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-065154f5-832c-4f1a-b19a-476b93ebd90c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:46.186503 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-065154f5-832c-4f1a-b19a-476b93ebd90c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:46.370445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-0f2296d7-92d5-4a77-adcb-2aa1f618369e req-a4fe5288-02db-4e3e-89de-6c5c41669873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d49b4fd-206c-478c-9078-e3f88faedd9a", "name": "network-vif-plugged", "status": "completed", "tag": "ba399b8d-ed3f-49b4-ac2e-afa79260f403"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:46.392435 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-0f2296d7-92d5-4a77-adcb-2aa1f618369e req-a4fe5288-02db-4e3e-89de-6c5c41669873 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:46.393043 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-0f2296d7-92d5-4a77-adcb-2aa1f618369e req-a4fe5288-02db-4e3e-89de-6c5c41669873 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:46.424073 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-0f2296d7-92d5-4a77-adcb-2aa1f618369e req-a4fe5288-02db-4e3e-89de-6c5c41669873 service nova] Creating event network-vif-plugged:ba399b8d-ed3f-49b4-ac2e-afa79260f403 for instance 8d49b4fd-206c-478c-9078-e3f88faedd9a on hv-cinder-85083 Jul 25 05:37:46.436408 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-0f2296d7-92d5-4a77-adcb-2aa1f618369e req-a4fe5288-02db-4e3e-89de-6c5c41669873 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.685977 Jul 25 05:37:46.437508 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 50/89] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:46.453558 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b9866329-0673-4e34-9716-4a0c30b99910 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:46.454504 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b9866329-0673-4e34-9716-4a0c30b99910 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:46.468914 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b9866329-0673-4e34-9716-4a0c30b99910 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:46.471901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b9866329-0673-4e34-9716-4a0c30b99910 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:46.476735 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b9866329-0673-4e34-9716-4a0c30b99910 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:46.477617 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b9866329-0673-4e34-9716-4a0c30b99910 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:46.959294 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-065154f5-832c-4f1a-b19a-476b93ebd90c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:46.974201 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-065154f5-832c-4f1a-b19a-476b93ebd90c tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 0.821596 Jul 25 05:37:46.975380 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 40/90] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:46 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:37:46.984101 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-730e5335-3632-459a-8013-15eb7a2f9b9b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:46.985354 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-730e5335-3632-459a-8013-15eb7a2f9b9b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:47.008713 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-730e5335-3632-459a-8013-15eb7a2f9b9b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:47.013286 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b9866329-0673-4e34-9716-4a0c30b99910 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:47.018393 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-730e5335-3632-459a-8013-15eb7a2f9b9b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:47.027684 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-730e5335-3632-459a-8013-15eb7a2f9b9b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:47.030962 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-730e5335-3632-459a-8013-15eb7a2f9b9b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:47.034618 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b9866329-0673-4e34-9716-4a0c30b99910 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 0.584851 Jul 25 05:37:47.041917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 51/91] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:46 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:47.412961 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-730e5335-3632-459a-8013-15eb7a2f9b9b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:47.423048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-730e5335-3632-459a-8013-15eb7a2f9b9b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1367 microversion: 2.1 time: 0.446540 Jul 25 05:37:47.427871 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 41/92] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:46 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:47.994649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-fe078b22-3a39-437f-83e8-ac2e40295da6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:47.996755 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-fe078b22-3a39-437f-83e8-ac2e40295da6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:48.003871 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fe078b22-3a39-437f-83e8-ac2e40295da6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:48.004330 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fe078b22-3a39-437f-83e8-ac2e40295da6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:48.005127 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fe078b22-3a39-437f-83e8-ac2e40295da6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:48.005567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fe078b22-3a39-437f-83e8-ac2e40295da6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:48.058671 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ff7ef4bd-491e-4895-b72d-aedb3b276449 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:48.059293 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ff7ef4bd-491e-4895-b72d-aedb3b276449 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:48.074262 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ff7ef4bd-491e-4895-b72d-aedb3b276449 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:48.075381 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ff7ef4bd-491e-4895-b72d-aedb3b276449 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:48.085323 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ff7ef4bd-491e-4895-b72d-aedb3b276449 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:48.086040 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ff7ef4bd-491e-4895-b72d-aedb3b276449 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:48.465040 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ff7ef4bd-491e-4895-b72d-aedb3b276449 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:48.480884 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ff7ef4bd-491e-4895-b72d-aedb3b276449 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 0.426156 Jul 25 05:37:48.481967 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 42/93] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:48 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:37:48.487397 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e0c7b11f-f0e7-4f9b-ad2c-c17cb565cff5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:48.493471 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e0c7b11f-f0e7-4f9b-ad2c-c17cb565cff5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:48.508584 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e0c7b11f-f0e7-4f9b-ad2c-c17cb565cff5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:48.512083 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-fe078b22-3a39-437f-83e8-ac2e40295da6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:48.512965 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e0c7b11f-f0e7-4f9b-ad2c-c17cb565cff5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:48.513960 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e0c7b11f-f0e7-4f9b-ad2c-c17cb565cff5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:48.515175 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e0c7b11f-f0e7-4f9b-ad2c-c17cb565cff5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:48.525499 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-fe078b22-3a39-437f-83e8-ac2e40295da6 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 0.534452 Jul 25 05:37:48.529263 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 52/94] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:47 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:48.548669 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-1c0504f5-0bdf-4fbb-ad82-536454b4b8f8 req-2c9729a1-16a5-494d-88cf-e551d09fc7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12aaf07a-d8f0-46c4-98f9-ba47ee257fa7", "name": "network-vif-plugged", "status": "completed", "tag": "6d22bdd7-e942-45f4-b095-81aa2ad4c2d4"}, {"server_uuid": "8106f539-061c-475e-a74f-ba331c8dc856", "name": "network-vif-plugged", "status": "completed", "tag": "36da70ce-1188-4fd6-913c-922c1c4b037b"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:48.567555 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-1c0504f5-0bdf-4fbb-ad82-536454b4b8f8 req-2c9729a1-16a5-494d-88cf-e551d09fc7d0 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:48.568106 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-1c0504f5-0bdf-4fbb-ad82-536454b4b8f8 req-2c9729a1-16a5-494d-88cf-e551d09fc7d0 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:48.598690 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-1c0504f5-0bdf-4fbb-ad82-536454b4b8f8 req-2c9729a1-16a5-494d-88cf-e551d09fc7d0 service nova] Creating event network-vif-plugged:6d22bdd7-e942-45f4-b095-81aa2ad4c2d4 for instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 on hv-cinder-85083 Jul 25 05:37:48.599093 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-1c0504f5-0bdf-4fbb-ad82-536454b4b8f8 req-2c9729a1-16a5-494d-88cf-e551d09fc7d0 service nova] Creating event network-vif-plugged:36da70ce-1188-4fd6-913c-922c1c4b037b for instance 8106f539-061c-475e-a74f-ba331c8dc856 on hv-cinder-85083 Jul 25 05:37:48.615872 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-1c0504f5-0bdf-4fbb-ad82-536454b4b8f8 req-2c9729a1-16a5-494d-88cf-e551d09fc7d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072229 Jul 25 05:37:48.619008 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 53/95] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:48.694614 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e0c7b11f-f0e7-4f9b-ad2c-c17cb565cff5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:48.705344 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e0c7b11f-f0e7-4f9b-ad2c-c17cb565cff5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1367 microversion: 2.1 time: 0.221910 Jul 25 05:37:48.715683 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 43/96] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:48 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:49.502193 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f42dc244-dada-4105-882c-4d1f24d36b01 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:49.503280 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f42dc244-dada-4105-882c-4d1f24d36b01 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:49.512372 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f42dc244-dada-4105-882c-4d1f24d36b01 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:49.513277 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f42dc244-dada-4105-882c-4d1f24d36b01 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:49.514017 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f42dc244-dada-4105-882c-4d1f24d36b01 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:49.514455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f42dc244-dada-4105-882c-4d1f24d36b01 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:49.548062 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-329ac9ad-4e87-4e44-beb3-bd0b1feddc52 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:49.549928 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-329ac9ad-4e87-4e44-beb3-bd0b1feddc52 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:49.559043 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-329ac9ad-4e87-4e44-beb3-bd0b1feddc52 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:49.559836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-329ac9ad-4e87-4e44-beb3-bd0b1feddc52 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:49.560960 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-329ac9ad-4e87-4e44-beb3-bd0b1feddc52 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:49.561594 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-329ac9ad-4e87-4e44-beb3-bd0b1feddc52 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:49.676985 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f42dc244-dada-4105-882c-4d1f24d36b01 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:49.699789 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f42dc244-dada-4105-882c-4d1f24d36b01 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1322 microversion: 2.1 time: 0.203424 Jul 25 05:37:49.700429 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 54/97] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:49 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:49.727407 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7cb0351e-ef3b-4b1e-9ce2-d59c6ca61810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:49.728340 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7cb0351e-ef3b-4b1e-9ce2-d59c6ca61810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:49.748064 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7cb0351e-ef3b-4b1e-9ce2-d59c6ca61810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:49.748790 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7cb0351e-ef3b-4b1e-9ce2-d59c6ca61810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:49.751168 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7cb0351e-ef3b-4b1e-9ce2-d59c6ca61810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:49.751802 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7cb0351e-ef3b-4b1e-9ce2-d59c6ca61810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:49.855041 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=4 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:49.877025 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=10 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:50.069864 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:50.162709 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-329ac9ad-4e87-4e44-beb3-bd0b1feddc52 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:50.167750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7cb0351e-ef3b-4b1e-9ce2-d59c6ca61810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:50.172602 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-329ac9ad-4e87-4e44-beb3-bd0b1feddc52 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1315 microversion: 2.1 time: 0.629919 Jul 25 05:37:50.187174 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 44/98] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:49 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:50.189825 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7cb0351e-ef3b-4b1e-9ce2-d59c6ca61810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1367 microversion: 2.1 time: 0.470980 Jul 25 05:37:50.190808 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 55/99] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:49 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1367 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:37:50.634453 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-a15ef3a6-c499-4d6d-a292-b3627f2614c6 req-88306a62-2590-4b08-bae7-da4b151899b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a28e80-5bf2-46af-9ece-8f7d147629fe", "name": "network-vif-plugged", "status": "completed", "tag": "96397b18-73bc-4e7f-abf2-2e7a32610b85"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:50.657711 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a15ef3a6-c499-4d6d-a292-b3627f2614c6 req-88306a62-2590-4b08-bae7-da4b151899b8 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:50.660113 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a15ef3a6-c499-4d6d-a292-b3627f2614c6 req-88306a62-2590-4b08-bae7-da4b151899b8 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:50.682879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-a15ef3a6-c499-4d6d-a292-b3627f2614c6 req-88306a62-2590-4b08-bae7-da4b151899b8 service nova] Creating event network-vif-plugged:96397b18-73bc-4e7f-abf2-2e7a32610b85 for instance f5a28e80-5bf2-46af-9ece-8f7d147629fe on hv-cinder-85083 Jul 25 05:37:50.689374 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-a15ef3a6-c499-4d6d-a292-b3627f2614c6 req-88306a62-2590-4b08-bae7-da4b151899b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060708 Jul 25 05:37:50.690123 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 45/100] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:50.718836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a299b2c1-9f8c-4584-b5bf-30c5b51e56b4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:50.719532 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a299b2c1-9f8c-4584-b5bf-30c5b51e56b4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:50.730269 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a299b2c1-9f8c-4584-b5bf-30c5b51e56b4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:50.732143 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a299b2c1-9f8c-4584-b5bf-30c5b51e56b4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:50.734027 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a299b2c1-9f8c-4584-b5bf-30c5b51e56b4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:50.734729 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a299b2c1-9f8c-4584-b5bf-30c5b51e56b4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:50.948544 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a299b2c1-9f8c-4584-b5bf-30c5b51e56b4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:50.958409 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a299b2c1-9f8c-4584-b5bf-30c5b51e56b4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1516 microversion: 2.1 time: 0.244508 Jul 25 05:37:50.959543 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 56/101] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:50 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:50.978499 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-22de56b7-1dbe-495c-9f66-d07686db08a5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:50.980360 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-22de56b7-1dbe-495c-9f66-d07686db08a5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:50.988549 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22de56b7-1dbe-495c-9f66-d07686db08a5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:50.989157 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22de56b7-1dbe-495c-9f66-d07686db08a5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:50.990068 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22de56b7-1dbe-495c-9f66-d07686db08a5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:50.990813 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22de56b7-1dbe-495c-9f66-d07686db08a5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:51.049728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:51.063804 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-22de56b7-1dbe-495c-9f66-d07686db08a5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lazy-loading 'flavor' on Instance uuid 8d49b4fd-206c-478c-9078-e3f88faedd9a {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:37:51.193768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8eb4cd17-fd30-4eb0-a32c-a77300cc792d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:51.194396 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8eb4cd17-fd30-4eb0-a32c-a77300cc792d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:51.208169 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8eb4cd17-fd30-4eb0-a32c-a77300cc792d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:51.208641 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8eb4cd17-fd30-4eb0-a32c-a77300cc792d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:51.212325 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8eb4cd17-fd30-4eb0-a32c-a77300cc792d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:51.213365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8eb4cd17-fd30-4eb0-a32c-a77300cc792d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:51.230767 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-22de56b7-1dbe-495c-9f66-d07686db08a5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "POST /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a/action" status: 200 len: 32 microversion: 2.1 time: 0.256542 Jul 25 05:37:51.231640 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 46/102] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:37:50 2022] POST /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 05:37:51.239108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b0ef95b4-264a-4535-8eb9-23b7e0ed3c69 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:51.240166 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b0ef95b4-264a-4535-8eb9-23b7e0ed3c69 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:51.250819 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0ef95b4-264a-4535-8eb9-23b7e0ed3c69 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:51.251293 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0ef95b4-264a-4535-8eb9-23b7e0ed3c69 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:51.253575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0ef95b4-264a-4535-8eb9-23b7e0ed3c69 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:51.254396 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0ef95b4-264a-4535-8eb9-23b7e0ed3c69 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:51.472861 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8eb4cd17-fd30-4eb0-a32c-a77300cc792d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:51.482802 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8eb4cd17-fd30-4eb0-a32c-a77300cc792d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1502 microversion: 2.1 time: 0.291511 Jul 25 05:37:51.484129 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 57/103] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:51 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1502 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:37:51.489300 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d2bdc921-b403-4f1a-bb4c-e699743de64e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:51.490149 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d2bdc921-b403-4f1a-bb4c-e699743de64e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:51.496696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2bdc921-b403-4f1a-bb4c-e699743de64e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:51.497184 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2bdc921-b403-4f1a-bb4c-e699743de64e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:51.498121 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2bdc921-b403-4f1a-bb4c-e699743de64e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:51.510583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2bdc921-b403-4f1a-bb4c-e699743de64e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:51.530975 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b0ef95b4-264a-4535-8eb9-23b7e0ed3c69 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:51.539766 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b0ef95b4-264a-4535-8eb9-23b7e0ed3c69 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1367 microversion: 2.1 time: 0.306679 Jul 25 05:37:51.544860 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 47/104] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:51 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:51.721227 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d2bdc921-b403-4f1a-bb4c-e699743de64e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:51.734608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d2bdc921-b403-4f1a-bb4c-e699743de64e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.248189 Jul 25 05:37:51.736095 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 58/105] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:51 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:52.573874 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-365d8e8e-a84f-46ba-8c4e-0af6a2706709 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:52.575320 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-365d8e8e-a84f-46ba-8c4e-0af6a2706709 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:52.588675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-365d8e8e-a84f-46ba-8c4e-0af6a2706709 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:52.589615 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-365d8e8e-a84f-46ba-8c4e-0af6a2706709 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:52.590781 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-365d8e8e-a84f-46ba-8c4e-0af6a2706709 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:52.591239 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-365d8e8e-a84f-46ba-8c4e-0af6a2706709 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:52.755569 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6966a5f9-5240-440f-8c2d-498f81f4a149 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:52.757124 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6966a5f9-5240-440f-8c2d-498f81f4a149 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:52.771131 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6966a5f9-5240-440f-8c2d-498f81f4a149 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:52.778371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6966a5f9-5240-440f-8c2d-498f81f4a149 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:52.781147 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6966a5f9-5240-440f-8c2d-498f81f4a149 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:52.781932 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-365d8e8e-a84f-46ba-8c4e-0af6a2706709 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:52.783850 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6966a5f9-5240-440f-8c2d-498f81f4a149 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:52.789364 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-365d8e8e-a84f-46ba-8c4e-0af6a2706709 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1367 microversion: 2.1 time: 0.235357 Jul 25 05:37:52.792408 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 48/106] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:52 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:53.009023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ecf9e809-b1b7-45de-b5de-1cafcb3fb28f tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a76d8759-172e-44e0-929d-7649b04f975b"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:37:53.010090 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ecf9e809-b1b7-45de-b5de-1cafcb3fb28f tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:53.030243 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ecf9e809-b1b7-45de-b5de-1cafcb3fb28f tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:53.033859 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ecf9e809-b1b7-45de-b5de-1cafcb3fb28f tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:53.034762 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ecf9e809-b1b7-45de-b5de-1cafcb3fb28f tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:53.035857 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ecf9e809-b1b7-45de-b5de-1cafcb3fb28f tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:53.170868 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6966a5f9-5240-440f-8c2d-498f81f4a149 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:53.191298 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6966a5f9-5240-440f-8c2d-498f81f4a149 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.438546 Jul 25 05:37:53.202782 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 59/107] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:52 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:53.803183 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ecf9e809-b1b7-45de-b5de-1cafcb3fb28f tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "POST /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798347 Jul 25 05:37:53.804819 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 49/108] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:37:53 2022] POST /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:53.810430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-39451b81-643f-434c-a706-8c2e691af75d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:53.811794 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-39451b81-643f-434c-a706-8c2e691af75d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:53.819277 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-39451b81-643f-434c-a706-8c2e691af75d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:53.819732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-39451b81-643f-434c-a706-8c2e691af75d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:53.820711 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-39451b81-643f-434c-a706-8c2e691af75d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:53.821915 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-39451b81-643f-434c-a706-8c2e691af75d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:53.998883 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-39451b81-643f-434c-a706-8c2e691af75d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:54.006401 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-39451b81-643f-434c-a706-8c2e691af75d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1367 microversion: 2.1 time: 0.200743 Jul 25 05:37:54.006966 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 60/109] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:53 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:37:54.216722 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cc7db2e4-6a5d-46b4-9204-17757600f6bb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:54.217461 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cc7db2e4-6a5d-46b4-9204-17757600f6bb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:54.223682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc7db2e4-6a5d-46b4-9204-17757600f6bb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:54.224138 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc7db2e4-6a5d-46b4-9204-17757600f6bb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:54.224931 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc7db2e4-6a5d-46b4-9204-17757600f6bb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:54.225373 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc7db2e4-6a5d-46b4-9204-17757600f6bb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:54.370274 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cc7db2e4-6a5d-46b4-9204-17757600f6bb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:54.378473 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cc7db2e4-6a5d-46b4-9204-17757600f6bb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.170471 Jul 25 05:37:54.379048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 50/110] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:54 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:55.023115 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c80c44cf-5012-4ee4-b9ab-267e25764be4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:55.023739 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c80c44cf-5012-4ee4-b9ab-267e25764be4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:55.030668 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c80c44cf-5012-4ee4-b9ab-267e25764be4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:55.031132 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c80c44cf-5012-4ee4-b9ab-267e25764be4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:55.031905 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c80c44cf-5012-4ee4-b9ab-267e25764be4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:55.032348 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c80c44cf-5012-4ee4-b9ab-267e25764be4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:55.164278 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-c80c44cf-5012-4ee4-b9ab-267e25764be4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:55.172371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c80c44cf-5012-4ee4-b9ab-267e25764be4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1367 microversion: 2.1 time: 0.153044 Jul 25 05:37:55.173154 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 61/111] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:55 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:55.395232 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5c9a448f-3718-4292-b0c9-facf6b50519d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:55.395850 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5c9a448f-3718-4292-b0c9-facf6b50519d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:55.403289 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c9a448f-3718-4292-b0c9-facf6b50519d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:55.403814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c9a448f-3718-4292-b0c9-facf6b50519d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:55.404648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c9a448f-3718-4292-b0c9-facf6b50519d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:55.405187 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c9a448f-3718-4292-b0c9-facf6b50519d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:55.534688 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5c9a448f-3718-4292-b0c9-facf6b50519d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:55.542862 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5c9a448f-3718-4292-b0c9-facf6b50519d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.151419 Jul 25 05:37:55.543433 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 51/112] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:55 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:56.189260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d992641f-2fc5-4727-bbf3-07c1e5a6c308 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:56.189879 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d992641f-2fc5-4727-bbf3-07c1e5a6c308 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:56.195827 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d992641f-2fc5-4727-bbf3-07c1e5a6c308 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:56.196280 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d992641f-2fc5-4727-bbf3-07c1e5a6c308 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:56.197069 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d992641f-2fc5-4727-bbf3-07c1e5a6c308 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:56.197513 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d992641f-2fc5-4727-bbf3-07c1e5a6c308 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:56.332309 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d992641f-2fc5-4727-bbf3-07c1e5a6c308 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:56.340472 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d992641f-2fc5-4727-bbf3-07c1e5a6c308 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1367 microversion: 2.1 time: 0.155008 Jul 25 05:37:56.341055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 62/113] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:56 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:56.560520 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-10b64b6e-d71a-4e70-8b1b-ac37e4da4267 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:56.561228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-10b64b6e-d71a-4e70-8b1b-ac37e4da4267 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:56.567482 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-10b64b6e-d71a-4e70-8b1b-ac37e4da4267 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:56.567937 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-10b64b6e-d71a-4e70-8b1b-ac37e4da4267 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:56.568697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-10b64b6e-d71a-4e70-8b1b-ac37e4da4267 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:56.569182 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-10b64b6e-d71a-4e70-8b1b-ac37e4da4267 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:56.795613 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-10b64b6e-d71a-4e70-8b1b-ac37e4da4267 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:56.803229 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-10b64b6e-d71a-4e70-8b1b-ac37e4da4267 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.247396 Jul 25 05:37:56.803808 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 52/114] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:56 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:57.357859 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6d28e9c3-09bd-4fa3-896b-2ba4fb5ecb15 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:57.358450 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6d28e9c3-09bd-4fa3-896b-2ba4fb5ecb15 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:57.364424 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6d28e9c3-09bd-4fa3-896b-2ba4fb5ecb15 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:57.364923 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6d28e9c3-09bd-4fa3-896b-2ba4fb5ecb15 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:57.365679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6d28e9c3-09bd-4fa3-896b-2ba4fb5ecb15 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:57.366119 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6d28e9c3-09bd-4fa3-896b-2ba4fb5ecb15 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:57.497354 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6d28e9c3-09bd-4fa3-896b-2ba4fb5ecb15 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:57.505266 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6d28e9c3-09bd-4fa3-896b-2ba4fb5ecb15 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1367 microversion: 2.1 time: 0.151891 Jul 25 05:37:57.505824 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 63/115] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:57 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:57.820619 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ca7f47c9-f48a-4124-a977-4d3aaae3fb55 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:57.821398 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ca7f47c9-f48a-4124-a977-4d3aaae3fb55 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:57.829178 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ca7f47c9-f48a-4124-a977-4d3aaae3fb55 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:57.829639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ca7f47c9-f48a-4124-a977-4d3aaae3fb55 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:57.830720 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ca7f47c9-f48a-4124-a977-4d3aaae3fb55 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:57.831343 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ca7f47c9-f48a-4124-a977-4d3aaae3fb55 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:57.971295 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ca7f47c9-f48a-4124-a977-4d3aaae3fb55 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:57.978972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ca7f47c9-f48a-4124-a977-4d3aaae3fb55 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.162458 Jul 25 05:37:57.979635 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 53/116] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:57 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:58.523102 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1e379940-29ec-4b61-b633-e5b017f72a51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:58.525209 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1e379940-29ec-4b61-b633-e5b017f72a51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:58.537848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1e379940-29ec-4b61-b633-e5b017f72a51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:58.538895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1e379940-29ec-4b61-b633-e5b017f72a51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:58.540043 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1e379940-29ec-4b61-b633-e5b017f72a51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:58.540509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1e379940-29ec-4b61-b633-e5b017f72a51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:58.707377 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1e379940-29ec-4b61-b633-e5b017f72a51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:58.715485 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1e379940-29ec-4b61-b633-e5b017f72a51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1557 microversion: 2.1 time: 0.196273 Jul 25 05:37:58.733469 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6a010d7c-271b-46c0-9c67-e910981c7a60 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:58.734029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6a010d7c-271b-46c0-9c67-e910981c7a60 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:58.735867 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 64/117] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:58 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:37:58.740813 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a010d7c-271b-46c0-9c67-e910981c7a60 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:58.741717 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a010d7c-271b-46c0-9c67-e910981c7a60 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:58.743076 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a010d7c-271b-46c0-9c67-e910981c7a60 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:58.744043 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a010d7c-271b-46c0-9c67-e910981c7a60 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:58.827904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6a010d7c-271b-46c0-9c67-e910981c7a60 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098979 Jul 25 05:37:58.828494 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 54/118] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 25 05:37:58 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:37:58.996631 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-26b0367f-7278-4b75-9fb6-d538ec209ad1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:37:58.997638 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-26b0367f-7278-4b75-9fb6-d538ec209ad1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:37:59.003898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26b0367f-7278-4b75-9fb6-d538ec209ad1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:59.004362 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26b0367f-7278-4b75-9fb6-d538ec209ad1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:59.005243 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26b0367f-7278-4b75-9fb6-d538ec209ad1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:37:59.005767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26b0367f-7278-4b75-9fb6-d538ec209ad1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:37:59.021568 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=100 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:59.198560 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-26b0367f-7278-4b75-9fb6-d538ec209ad1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:37:59.212097 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-26b0367f-7278-4b75-9fb6-d538ec209ad1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.219421 Jul 25 05:37:59.214212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 65/119] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:37:58 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:00.209789 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-f69488da-385e-4f81-b2e7-d177c8e212a2 req-83c6b607-fb6b-4631-814a-041926b94306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a28e80-5bf2-46af-9ece-8f7d147629fe", "tag": "96397b18-73bc-4e7f-abf2-2e7a32610b85"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:38:00.221817 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-f69488da-385e-4f81-b2e7-d177c8e212a2 req-83c6b607-fb6b-4631-814a-041926b94306 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:00.222379 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-f69488da-385e-4f81-b2e7-d177c8e212a2 req-83c6b607-fb6b-4631-814a-041926b94306 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:00.231344 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8aaa5d37-8515-4e40-94a4-1de8d0ace902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:00.232492 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8aaa5d37-8515-4e40-94a4-1de8d0ace902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:00.238642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-f69488da-385e-4f81-b2e7-d177c8e212a2 req-83c6b607-fb6b-4631-814a-041926b94306 service nova] Creating event network-changed:96397b18-73bc-4e7f-abf2-2e7a32610b85 for instance f5a28e80-5bf2-46af-9ece-8f7d147629fe on hv-cinder-85083 Jul 25 05:38:00.244176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-f69488da-385e-4f81-b2e7-d177c8e212a2 req-83c6b607-fb6b-4631-814a-041926b94306 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039535 Jul 25 05:38:00.244433 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8aaa5d37-8515-4e40-94a4-1de8d0ace902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:00.244973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8aaa5d37-8515-4e40-94a4-1de8d0ace902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:00.245905 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 55/120] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:38:00.248847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8aaa5d37-8515-4e40-94a4-1de8d0ace902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:00.249589 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8aaa5d37-8515-4e40-94a4-1de8d0ace902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:00.446359 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8aaa5d37-8515-4e40-94a4-1de8d0ace902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:00.458719 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8aaa5d37-8515-4e40-94a4-1de8d0ace902 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.231824 Jul 25 05:38:00.459537 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 66/121] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:00 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:01.477736 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3589af45-8746-4e97-b9b8-08d7ea1ea8cd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:01.478531 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3589af45-8746-4e97-b9b8-08d7ea1ea8cd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:01.486690 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3589af45-8746-4e97-b9b8-08d7ea1ea8cd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:01.487549 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3589af45-8746-4e97-b9b8-08d7ea1ea8cd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:01.488590 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3589af45-8746-4e97-b9b8-08d7ea1ea8cd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:01.489273 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3589af45-8746-4e97-b9b8-08d7ea1ea8cd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:01.773872 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3589af45-8746-4e97-b9b8-08d7ea1ea8cd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:01.785454 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3589af45-8746-4e97-b9b8-08d7ea1ea8cd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.312269 Jul 25 05:38:01.786035 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 56/122] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:01 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:02.810931 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ee9a4728-02d4-44a6-bdf8-fc2180a20d7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:02.811667 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ee9a4728-02d4-44a6-bdf8-fc2180a20d7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:02.817723 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ee9a4728-02d4-44a6-bdf8-fc2180a20d7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:02.818177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ee9a4728-02d4-44a6-bdf8-fc2180a20d7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:02.818945 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ee9a4728-02d4-44a6-bdf8-fc2180a20d7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:02.819401 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ee9a4728-02d4-44a6-bdf8-fc2180a20d7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:02.949358 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ee9a4728-02d4-44a6-bdf8-fc2180a20d7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:02.957023 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ee9a4728-02d4-44a6-bdf8-fc2180a20d7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.157794 Jul 25 05:38:02.957598 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 67/123] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:02 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:03.974434 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ba06150a-b773-47da-b325-6441659cc19a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:03.975618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ba06150a-b773-47da-b325-6441659cc19a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:03.983149 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ba06150a-b773-47da-b325-6441659cc19a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:03.983602 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ba06150a-b773-47da-b325-6441659cc19a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:03.984356 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ba06150a-b773-47da-b325-6441659cc19a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:03.984813 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ba06150a-b773-47da-b325-6441659cc19a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:04.111358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ba06150a-b773-47da-b325-6441659cc19a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:04.118711 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ba06150a-b773-47da-b325-6441659cc19a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.148137 Jul 25 05:38:04.119284 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 57/124] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:03 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:05.136720 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ab3fb6cc-493f-444f-8af2-304344b44025 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:05.137959 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ab3fb6cc-493f-444f-8af2-304344b44025 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:05.140532 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:05.146329 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ab3fb6cc-493f-444f-8af2-304344b44025 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:05.146725 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ab3fb6cc-493f-444f-8af2-304344b44025 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:05.147481 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ab3fb6cc-493f-444f-8af2-304344b44025 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:05.147924 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ab3fb6cc-493f-444f-8af2-304344b44025 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:05.281394 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ab3fb6cc-493f-444f-8af2-304344b44025 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:05.288806 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ab3fb6cc-493f-444f-8af2-304344b44025 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.155962 Jul 25 05:38:05.289374 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 68/125] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:05 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:06.306672 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3d6c1554-bbeb-4644-a962-578c030c435a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:06.307326 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3d6c1554-bbeb-4644-a962-578c030c435a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:06.314390 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=62 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:06.316024 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3d6c1554-bbeb-4644-a962-578c030c435a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:06.317176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3d6c1554-bbeb-4644-a962-578c030c435a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:06.318839 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3d6c1554-bbeb-4644-a962-578c030c435a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:06.320733 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3d6c1554-bbeb-4644-a962-578c030c435a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:06.505498 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3d6c1554-bbeb-4644-a962-578c030c435a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:06.513874 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3d6c1554-bbeb-4644-a962-578c030c435a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.211676 Jul 25 05:38:06.515033 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 58/126] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:06 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:07.531085 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-00818196-6132-4ccc-a467-d5d226f00586 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:07.531683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-00818196-6132-4ccc-a467-d5d226f00586 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:07.537672 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-00818196-6132-4ccc-a467-d5d226f00586 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:07.538121 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-00818196-6132-4ccc-a467-d5d226f00586 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:07.538869 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-00818196-6132-4ccc-a467-d5d226f00586 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:07.539307 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-00818196-6132-4ccc-a467-d5d226f00586 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:07.668449 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-00818196-6132-4ccc-a467-d5d226f00586 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:07.675980 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-00818196-6132-4ccc-a467-d5d226f00586 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.149482 Jul 25 05:38:07.676563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 69/127] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:07 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:08.692848 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8f856d93-48c8-4dc4-91f4-9b65af946ac3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:08.693493 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8f856d93-48c8-4dc4-91f4-9b65af946ac3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:08.700507 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f856d93-48c8-4dc4-91f4-9b65af946ac3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:08.700985 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f856d93-48c8-4dc4-91f4-9b65af946ac3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:08.701742 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f856d93-48c8-4dc4-91f4-9b65af946ac3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:08.702182 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f856d93-48c8-4dc4-91f4-9b65af946ac3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:08.836318 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8f856d93-48c8-4dc4-91f4-9b65af946ac3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:08.843752 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8f856d93-48c8-4dc4-91f4-9b65af946ac3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.154870 Jul 25 05:38:08.844395 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 59/128] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:08 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:09.860935 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5f7b7102-9c72-4ad0-a96c-d829dd7125c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:09.862243 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5f7b7102-9c72-4ad0-a96c-d829dd7125c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:09.871025 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5f7b7102-9c72-4ad0-a96c-d829dd7125c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:09.876250 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5f7b7102-9c72-4ad0-a96c-d829dd7125c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:09.877146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5f7b7102-9c72-4ad0-a96c-d829dd7125c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:09.877595 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5f7b7102-9c72-4ad0-a96c-d829dd7125c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:10.063805 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a81cf21a-4fbc-41ce-bcdc-8d453ff4e19a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:10.064322 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a81cf21a-4fbc-41ce-bcdc-8d453ff4e19a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:10.071101 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a81cf21a-4fbc-41ce-bcdc-8d453ff4e19a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:10.072125 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a81cf21a-4fbc-41ce-bcdc-8d453ff4e19a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:10.073013 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a81cf21a-4fbc-41ce-bcdc-8d453ff4e19a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:10.073895 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a81cf21a-4fbc-41ce-bcdc-8d453ff4e19a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:10.103157 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5f7b7102-9c72-4ad0-a96c-d829dd7125c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:10.107078 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a81cf21a-4fbc-41ce-bcdc-8d453ff4e19a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:38:10.110671 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:10.111743 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5f7b7102-9c72-4ad0-a96c-d829dd7125c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.254977 Jul 25 05:38:10.112637 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 70/129] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:09 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:10.198517 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a81cf21a-4fbc-41ce-bcdc-8d453ff4e19a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 204 len: 0 microversion: 2.1 time: 0.139239 Jul 25 05:38:10.199231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 60/130] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:38:10 2022] DELETE /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 05:38:10.208412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ebffc219-d612-405a-830e-e9737ee76e8e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:10.209042 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ebffc219-d612-405a-830e-e9737ee76e8e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:10.215011 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ebffc219-d612-405a-830e-e9737ee76e8e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:10.215494 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ebffc219-d612-405a-830e-e9737ee76e8e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:10.216248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ebffc219-d612-405a-830e-e9737ee76e8e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:10.216674 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ebffc219-d612-405a-830e-e9737ee76e8e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:10.361378 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ebffc219-d612-405a-830e-e9737ee76e8e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:10.370029 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ebffc219-d612-405a-830e-e9737ee76e8e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1554 microversion: 2.1 time: 0.165515 Jul 25 05:38:10.370636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 71/131] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:10 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:11.131784 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-18e2e94e-e003-40eb-8fd8-0713217e0078 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:11.132503 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-18e2e94e-e003-40eb-8fd8-0713217e0078 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:11.141440 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-18e2e94e-e003-40eb-8fd8-0713217e0078 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:11.142352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-18e2e94e-e003-40eb-8fd8-0713217e0078 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:11.143141 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-18e2e94e-e003-40eb-8fd8-0713217e0078 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:11.143590 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-18e2e94e-e003-40eb-8fd8-0713217e0078 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:11.308925 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-18e2e94e-e003-40eb-8fd8-0713217e0078 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:11.318193 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-18e2e94e-e003-40eb-8fd8-0713217e0078 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.193060 Jul 25 05:38:11.319540 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 61/132] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:11 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:11.395926 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1134ad39-0cd1-42e2-a110-0fb0f2efcf0b tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:11.396538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1134ad39-0cd1-42e2-a110-0fb0f2efcf0b tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:11.403012 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1134ad39-0cd1-42e2-a110-0fb0f2efcf0b tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:11.403405 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1134ad39-0cd1-42e2-a110-0fb0f2efcf0b tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:11.404185 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1134ad39-0cd1-42e2-a110-0fb0f2efcf0b tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:11.404639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1134ad39-0cd1-42e2-a110-0fb0f2efcf0b tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:11.554273 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1134ad39-0cd1-42e2-a110-0fb0f2efcf0b tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:11.564012 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1134ad39-0cd1-42e2-a110-0fb0f2efcf0b tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1554 microversion: 2.1 time: 0.171817 Jul 25 05:38:11.564603 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 72/133] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:11 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:12.337865 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-66151ffb-aa3e-4299-980a-deffa6bf1e98 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:12.339098 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-66151ffb-aa3e-4299-980a-deffa6bf1e98 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:12.347393 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66151ffb-aa3e-4299-980a-deffa6bf1e98 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:12.348154 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66151ffb-aa3e-4299-980a-deffa6bf1e98 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:12.349903 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66151ffb-aa3e-4299-980a-deffa6bf1e98 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:12.350791 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66151ffb-aa3e-4299-980a-deffa6bf1e98 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:12.569118 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-66151ffb-aa3e-4299-980a-deffa6bf1e98 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:12.579904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-66151ffb-aa3e-4299-980a-deffa6bf1e98 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.246105 Jul 25 05:38:12.582004 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 62/134] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:12 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:12.594366 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8ee290aa-00e2-447a-a62b-a2a03894563e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:12.594990 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8ee290aa-00e2-447a-a62b-a2a03894563e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:12.604447 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8ee290aa-00e2-447a-a62b-a2a03894563e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:12.606792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8ee290aa-00e2-447a-a62b-a2a03894563e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:12.607596 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8ee290aa-00e2-447a-a62b-a2a03894563e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:12.608034 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8ee290aa-00e2-447a-a62b-a2a03894563e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:12.812551 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8ee290aa-00e2-447a-a62b-a2a03894563e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:12.821779 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8ee290aa-00e2-447a-a62b-a2a03894563e tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1554 microversion: 2.1 time: 0.243525 Jul 25 05:38:12.822728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 73/135] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:12 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:38:13.599138 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a1eca749-7c04-4dc6-aa77-12e55e4c6506 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:13.599750 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a1eca749-7c04-4dc6-aa77-12e55e4c6506 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:13.606785 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a1eca749-7c04-4dc6-aa77-12e55e4c6506 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:13.607550 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a1eca749-7c04-4dc6-aa77-12e55e4c6506 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:13.608685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a1eca749-7c04-4dc6-aa77-12e55e4c6506 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:13.609298 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a1eca749-7c04-4dc6-aa77-12e55e4c6506 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:13.825618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a1eca749-7c04-4dc6-aa77-12e55e4c6506 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:13.833584 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a1eca749-7c04-4dc6-aa77-12e55e4c6506 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.238297 Jul 25 05:38:13.834418 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 63/136] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:13 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:13.840795 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e8f90485-6bc4-44a7-8854-fb9363088a24 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:13.841424 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e8f90485-6bc4-44a7-8854-fb9363088a24 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:13.847542 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e8f90485-6bc4-44a7-8854-fb9363088a24 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:13.848256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e8f90485-6bc4-44a7-8854-fb9363088a24 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:13.849037 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e8f90485-6bc4-44a7-8854-fb9363088a24 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:13.849481 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e8f90485-6bc4-44a7-8854-fb9363088a24 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:14.007225 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e8f90485-6bc4-44a7-8854-fb9363088a24 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:14.030213 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e8f90485-6bc4-44a7-8854-fb9363088a24 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1554 microversion: 2.1 time: 0.194346 Jul 25 05:38:14.042853 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 74/137] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:13 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:14.851731 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-71c57616-d2e7-43ae-b47b-458611ef1e6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:14.852755 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-71c57616-d2e7-43ae-b47b-458611ef1e6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:14.859940 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71c57616-d2e7-43ae-b47b-458611ef1e6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:14.860394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71c57616-d2e7-43ae-b47b-458611ef1e6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:14.861197 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71c57616-d2e7-43ae-b47b-458611ef1e6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:14.861630 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71c57616-d2e7-43ae-b47b-458611ef1e6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:15.008917 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-71c57616-d2e7-43ae-b47b-458611ef1e6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:15.016936 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-71c57616-d2e7-43ae-b47b-458611ef1e6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.169826 Jul 25 05:38:15.017703 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 64/138] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:14 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:15.050189 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-376f7416-3bb2-44a5-9cdd-73d6f5c5929d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:15.051166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-376f7416-3bb2-44a5-9cdd-73d6f5c5929d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:15.056931 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-376f7416-3bb2-44a5-9cdd-73d6f5c5929d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:15.057381 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-376f7416-3bb2-44a5-9cdd-73d6f5c5929d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:15.058142 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-376f7416-3bb2-44a5-9cdd-73d6f5c5929d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:15.058576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-376f7416-3bb2-44a5-9cdd-73d6f5c5929d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:15.220136 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-376f7416-3bb2-44a5-9cdd-73d6f5c5929d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:15.232478 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-376f7416-3bb2-44a5-9cdd-73d6f5c5929d tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1554 microversion: 2.1 time: 0.185949 Jul 25 05:38:15.238210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 75/139] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:15 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:16.035165 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0259114c-059f-4b32-8dda-bc0ff3e20b8b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:16.036195 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0259114c-059f-4b32-8dda-bc0ff3e20b8b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:16.042454 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0259114c-059f-4b32-8dda-bc0ff3e20b8b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:16.042911 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0259114c-059f-4b32-8dda-bc0ff3e20b8b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:16.043867 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0259114c-059f-4b32-8dda-bc0ff3e20b8b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:16.044310 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0259114c-059f-4b32-8dda-bc0ff3e20b8b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:16.251293 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-58eac4e8-832c-4126-b3ac-bb4b0714c6fb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:16.252120 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-58eac4e8-832c-4126-b3ac-bb4b0714c6fb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:16.261963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-58eac4e8-832c-4126-b3ac-bb4b0714c6fb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:16.263068 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-58eac4e8-832c-4126-b3ac-bb4b0714c6fb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:16.264511 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-58eac4e8-832c-4126-b3ac-bb4b0714c6fb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:16.265196 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-58eac4e8-832c-4126-b3ac-bb4b0714c6fb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:16.370787 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0259114c-059f-4b32-8dda-bc0ff3e20b8b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:16.395904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0259114c-059f-4b32-8dda-bc0ff3e20b8b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.365623 Jul 25 05:38:16.396591 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 65/140] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:16 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:16.702937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-58eac4e8-832c-4126-b3ac-bb4b0714c6fb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:16.714155 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-58eac4e8-832c-4126-b3ac-bb4b0714c6fb tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1554 microversion: 2.1 time: 0.468564 Jul 25 05:38:16.714736 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 76/141] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:16 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1554 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:16.856932 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-80918f1a-123f-4c79-b3b9-850e3d286d07 req-5e64de34-d92a-4a22-925a-344039d03da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8106f539-061c-475e-a74f-ba331c8dc856", "name": "network-vif-deleted", "tag": "36da70ce-1188-4fd6-913c-922c1c4b037b"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:38:16.867216 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-80918f1a-123f-4c79-b3b9-850e3d286d07 req-5e64de34-d92a-4a22-925a-344039d03da6 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:16.868527 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-80918f1a-123f-4c79-b3b9-850e3d286d07 req-5e64de34-d92a-4a22-925a-344039d03da6 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:16.884288 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-80918f1a-123f-4c79-b3b9-850e3d286d07 req-5e64de34-d92a-4a22-925a-344039d03da6 service nova] Creating event network-vif-deleted:36da70ce-1188-4fd6-913c-922c1c4b037b for instance 8106f539-061c-475e-a74f-ba331c8dc856 on hv-cinder-85083 Jul 25 05:38:16.890892 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-80918f1a-123f-4c79-b3b9-850e3d286d07 req-5e64de34-d92a-4a22-925a-344039d03da6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038424 Jul 25 05:38:16.891692 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 66/142] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:38:17.413393 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5ba865a1-9e2f-4c47-ad86-73e82fc04ea1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:17.414782 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5ba865a1-9e2f-4c47-ad86-73e82fc04ea1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:17.423026 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5ba865a1-9e2f-4c47-ad86-73e82fc04ea1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:17.428000 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5ba865a1-9e2f-4c47-ad86-73e82fc04ea1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:17.429135 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5ba865a1-9e2f-4c47-ad86-73e82fc04ea1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:17.429803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5ba865a1-9e2f-4c47-ad86-73e82fc04ea1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:17.616014 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5ba865a1-9e2f-4c47-ad86-73e82fc04ea1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:17.625627 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5ba865a1-9e2f-4c47-ad86-73e82fc04ea1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.216115 Jul 25 05:38:17.626526 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 77/143] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:17 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:17.737800 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-743b06d6-5793-4418-89f5-183b365c497a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:17.738574 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-743b06d6-5793-4418-89f5-183b365c497a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:17.748873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-743b06d6-5793-4418-89f5-183b365c497a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:17.749574 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-743b06d6-5793-4418-89f5-183b365c497a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:17.750459 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-743b06d6-5793-4418-89f5-183b365c497a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:17.751034 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-743b06d6-5793-4418-89f5-183b365c497a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:17.815585 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-743b06d6-5793-4418-89f5-183b365c497a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:17.816156 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-743b06d6-5793-4418-89f5-183b365c497a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:17.816977 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-743b06d6-5793-4418-89f5-183b365c497a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lazy-loading 'fault' on Instance uuid 8106f539-061c-475e-a74f-ba331c8dc856 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:38:17.891013 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-743b06d6-5793-4418-89f5-183b365c497a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf61ffac0e3143f6b44971158bd7a553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc32f383ef54d94aeb44d0bc3885614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:17.899073 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-743b06d6-5793-4418-89f5-183b365c497a tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 200 len: 1351 microversion: 2.1 time: 0.165814 Jul 25 05:38:17.899640 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 67/144] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:17 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 1351 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:18.646517 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2aa7f0df-cb2a-40c5-bd36-a501d2c0529f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:18.647136 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2aa7f0df-cb2a-40c5-bd36-a501d2c0529f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:18.653791 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2aa7f0df-cb2a-40c5-bd36-a501d2c0529f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:18.654441 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2aa7f0df-cb2a-40c5-bd36-a501d2c0529f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:18.655213 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2aa7f0df-cb2a-40c5-bd36-a501d2c0529f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:18.655745 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2aa7f0df-cb2a-40c5-bd36-a501d2c0529f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:18.825416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2aa7f0df-cb2a-40c5-bd36-a501d2c0529f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:18.834208 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2aa7f0df-cb2a-40c5-bd36-a501d2c0529f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.191607 Jul 25 05:38:18.835332 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 78/145] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:18 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:18.917228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-adcb8dbc-5a08-40ac-a3c7-c7e8ac745013 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:18.918037 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-adcb8dbc-5a08-40ac-a3c7-c7e8ac745013 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:18.925482 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-adcb8dbc-5a08-40ac-a3c7-c7e8ac745013 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:18.925939 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-adcb8dbc-5a08-40ac-a3c7-c7e8ac745013 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:18.926706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-adcb8dbc-5a08-40ac-a3c7-c7e8ac745013 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:18.927153 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-adcb8dbc-5a08-40ac-a3c7-c7e8ac745013 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:18.941939 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-adcb8dbc-5a08-40ac-a3c7-c7e8ac745013 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] HTTP exception thrown: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-adcb8dbc-5a08-40ac-a3c7-c7e8ac745013 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Request method failure captured: Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 HTTP/1.1 Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iwNccmXE5-kpXm49eXuuMSC2yORyV6ckNtN4VIJLmd1wFc0ZxENGZl3oStGgO_-ajGQNeeV_LBmR9x_blzmlzzYpWXSMb_QpA_sSXRobsjnmLjSWsjqiQ8IzVwhe-6MF0ZYDvoUS0C2M4tjEsetAsB0H1s0YEv2fW0McX0Tv_GLHM8 Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 0dc32f383ef54d94aeb44d0bc3885614 Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:38:18.947111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0dc32f383ef54d94aeb44d0bc3885614"}]}] Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 0dc32f383ef54d94aeb44d0bc3885614 Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-DeleteServersTestJSON-2121090648-project Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: bf61ffac0e3143f6b44971158bd7a553 Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-DeleteServersTestJSON-2121090648-project Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:18.948642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '8106f539-061c-475e-a74f-ba331c8dc856'} Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:38:18.949668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:18.951575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:38:18.953048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-adcb8dbc-5a08-40ac-a3c7-c7e8ac745013 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Returning 404 to user: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:38:18.953048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-adcb8dbc-5a08-40ac-a3c7-c7e8ac745013 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 404 len: 111 microversion: 2.1 time: 0.035282 Jul 25 05:38:18.953048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 68/146] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:18 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:38:19.053013 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c306c2ef-5e58-4b57-97c0-241b06147ccc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:19.054083 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c306c2ef-5e58-4b57-97c0-241b06147ccc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:19.060641 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c306c2ef-5e58-4b57-97c0-241b06147ccc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:19.061203 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c306c2ef-5e58-4b57-97c0-241b06147ccc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:19.061967 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c306c2ef-5e58-4b57-97c0-241b06147ccc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:19.062407 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c306c2ef-5e58-4b57-97c0-241b06147ccc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:19.108389 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-c306c2ef-5e58-4b57-97c0-241b06147ccc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] HTTP exception thrown: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c306c2ef-5e58-4b57-97c0-241b06147ccc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Request method failure captured: Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856/os-volume_attachments HTTP/1.1 Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwNccmXE5-kpXm49eXuuMSC2yORyV6ckNtN4VIJLmd1wFc0ZxENGZl3oStGgO_-ajGQNeeV_LBmR9x_blzmlzzYpWXSMb_QpA_sSXRobsjnmLjSWsjqiQ8IzVwhe-6MF0ZYDvoUS0C2M4tjEsetAsB0H1s0YEv2fW0McX0Tv_GLHM8 Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 0dc32f383ef54d94aeb44d0bc3885614 Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:38:19.113299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0dc32f383ef54d94aeb44d0bc3885614"}]}] Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 0dc32f383ef54d94aeb44d0bc3885614 Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-DeleteServersTestJSON-2121090648-project Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: bf61ffac0e3143f6b44971158bd7a553 Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-DeleteServersTestJSON-2121090648-project Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:19.114702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'server_id': '8106f539-061c-475e-a74f-ba331c8dc856'} Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:38:19.115453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:19.116583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:38:19.118751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c306c2ef-5e58-4b57-97c0-241b06147ccc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Returning 404 to user: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:38:19.118751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c306c2ef-5e58-4b57-97c0-241b06147ccc tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065674 Jul 25 05:38:19.118751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 79/147] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:38:19 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:38:19.851929 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-19c935df-70ad-4e81-9080-2edd1e475640 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:19.852544 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-19c935df-70ad-4e81-9080-2edd1e475640 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:19.859687 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-19c935df-70ad-4e81-9080-2edd1e475640 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:19.860138 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-19c935df-70ad-4e81-9080-2edd1e475640 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:19.860929 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-19c935df-70ad-4e81-9080-2edd1e475640 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:19.861371 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-19c935df-70ad-4e81-9080-2edd1e475640 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:19.993072 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-19c935df-70ad-4e81-9080-2edd1e475640 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:20.001571 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-19c935df-70ad-4e81-9080-2edd1e475640 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.153532 Jul 25 05:38:20.002124 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 69/148] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:19 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:21.018525 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-dea4db2a-2d9a-4019-885a-65ffb5448f9d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:21.019142 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-dea4db2a-2d9a-4019-885a-65ffb5448f9d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:21.025562 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dea4db2a-2d9a-4019-885a-65ffb5448f9d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:21.026020 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dea4db2a-2d9a-4019-885a-65ffb5448f9d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:21.026791 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dea4db2a-2d9a-4019-885a-65ffb5448f9d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:21.027235 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dea4db2a-2d9a-4019-885a-65ffb5448f9d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:21.158385 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-dea4db2a-2d9a-4019-885a-65ffb5448f9d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:21.165750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-dea4db2a-2d9a-4019-885a-65ffb5448f9d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.150980 Jul 25 05:38:21.166300 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 80/149] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:21 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:22.183024 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5064f41c-b704-41ef-bb21-615648091f6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:22.183937 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5064f41c-b704-41ef-bb21-615648091f6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:22.191468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5064f41c-b704-41ef-bb21-615648091f6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:22.191936 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5064f41c-b704-41ef-bb21-615648091f6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:22.192711 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5064f41c-b704-41ef-bb21-615648091f6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:22.193184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5064f41c-b704-41ef-bb21-615648091f6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:22.323856 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5064f41c-b704-41ef-bb21-615648091f6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:22.331548 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5064f41c-b704-41ef-bb21-615648091f6c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.152308 Jul 25 05:38:22.332105 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 70/150] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:22 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:23.348592 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ea877b9c-f797-40e2-bc7a-119f7f65f353 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:23.349244 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ea877b9c-f797-40e2-bc7a-119f7f65f353 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:23.355261 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ea877b9c-f797-40e2-bc7a-119f7f65f353 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:23.355719 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ea877b9c-f797-40e2-bc7a-119f7f65f353 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:23.356663 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ea877b9c-f797-40e2-bc7a-119f7f65f353 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:23.357285 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ea877b9c-f797-40e2-bc7a-119f7f65f353 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:23.498617 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ea877b9c-f797-40e2-bc7a-119f7f65f353 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:23.506751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ea877b9c-f797-40e2-bc7a-119f7f65f353 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.161894 Jul 25 05:38:23.507281 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 81/151] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:23 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:24.524228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2a4a57ff-744a-43e4-a275-2596c6846eda tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:24.524974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2a4a57ff-744a-43e4-a275-2596c6846eda tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:24.531453 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a4a57ff-744a-43e4-a275-2596c6846eda tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:24.531905 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a4a57ff-744a-43e4-a275-2596c6846eda tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:24.532677 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a4a57ff-744a-43e4-a275-2596c6846eda tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:24.533142 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a4a57ff-744a-43e4-a275-2596c6846eda tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:24.665857 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2a4a57ff-744a-43e4-a275-2596c6846eda tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:24.673368 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2a4a57ff-744a-43e4-a275-2596c6846eda tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.153169 Jul 25 05:38:24.673941 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 71/152] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:24 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:25.690951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-dd52ca3c-11c9-46c2-b3a7-4ff8e8737674 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:25.691566 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-dd52ca3c-11c9-46c2-b3a7-4ff8e8737674 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:25.697963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd52ca3c-11c9-46c2-b3a7-4ff8e8737674 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:25.698423 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd52ca3c-11c9-46c2-b3a7-4ff8e8737674 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:25.699180 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd52ca3c-11c9-46c2-b3a7-4ff8e8737674 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:25.699624 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd52ca3c-11c9-46c2-b3a7-4ff8e8737674 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:25.836908 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-dd52ca3c-11c9-46c2-b3a7-4ff8e8737674 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:25.839088 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=100 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:25.846584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-dd52ca3c-11c9-46c2-b3a7-4ff8e8737674 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.159468 Jul 25 05:38:25.847147 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 82/153] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:25 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:26.639416 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-09a80cd9-e9e3-44f3-9c1c-f5d064099769 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:26.640154 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-09a80cd9-e9e3-44f3-9c1c-f5d064099769 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:26.647563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09a80cd9-e9e3-44f3-9c1c-f5d064099769 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:26.648350 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09a80cd9-e9e3-44f3-9c1c-f5d064099769 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:26.649183 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09a80cd9-e9e3-44f3-9c1c-f5d064099769 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:26.649666 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09a80cd9-e9e3-44f3-9c1c-f5d064099769 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:26.663805 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-09a80cd9-e9e3-44f3-9c1c-f5d064099769 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] HTTP exception thrown: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-09a80cd9-e9e3-44f3-9c1c-f5d064099769 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Request method failure captured: Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 HTTP/1.1 Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iwNccmXE5-kpXm49eXuuMSC2yORyV6ckNtN4VIJLmd1wFc0ZxENGZl3oStGgO_-ajGQNeeV_LBmR9x_blzmlzzYpWXSMb_QpA_sSXRobsjnmLjSWsjqiQ8IzVwhe-6MF0ZYDvoUS0C2M4tjEsetAsB0H1s0YEv2fW0McX0Tv_GLHM8 Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 0dc32f383ef54d94aeb44d0bc3885614 Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:38:26.665405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0dc32f383ef54d94aeb44d0bc3885614"}]}] Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 0dc32f383ef54d94aeb44d0bc3885614 Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-DeleteServersTestJSON-2121090648-project Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: bf61ffac0e3143f6b44971158bd7a553 Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-DeleteServersTestJSON-2121090648-project Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:26.666801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '8106f539-061c-475e-a74f-ba331c8dc856'} Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:38:26.667583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:26.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:38:26.670823 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-09a80cd9-e9e3-44f3-9c1c-f5d064099769 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Returning 404 to user: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:38:26.670823 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-09a80cd9-e9e3-44f3-9c1c-f5d064099769 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 404 len: 111 microversion: 2.1 time: 0.032402 Jul 25 05:38:26.670823 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 72/154] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:38:26 2022] DELETE /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:38:26.676097 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-237456f7-ebd6-44f4-aa19-b480cca9f615 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:26.677408 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-237456f7-ebd6-44f4-aa19-b480cca9f615 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] [instance: 8106f539-061c-475e-a74f-ba331c8dc856] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:26.683785 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-237456f7-ebd6-44f4-aa19-b480cca9f615 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:26.684836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-237456f7-ebd6-44f4-aa19-b480cca9f615 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:26.686007 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-237456f7-ebd6-44f4-aa19-b480cca9f615 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:26.686968 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-237456f7-ebd6-44f4-aa19-b480cca9f615 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:26.707551 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-237456f7-ebd6-44f4-aa19-b480cca9f615 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] HTTP exception thrown: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-237456f7-ebd6-44f4-aa19-b480cca9f615 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Request method failure captured: Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 HTTP/1.1 Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwNccmXE5-kpXm49eXuuMSC2yORyV6ckNtN4VIJLmd1wFc0ZxENGZl3oStGgO_-ajGQNeeV_LBmR9x_blzmlzzYpWXSMb_QpA_sSXRobsjnmLjSWsjqiQ8IzVwhe-6MF0ZYDvoUS0C2M4tjEsetAsB0H1s0YEv2fW0McX0Tv_GLHM8 Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 0dc32f383ef54d94aeb44d0bc3885614 Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:38:26.710445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dc32f383ef54d94aeb44d0bc3885614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0dc32f383ef54d94aeb44d0bc3885614"}]}] Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 0dc32f383ef54d94aeb44d0bc3885614 Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-DeleteServersTestJSON-2121090648 Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-DeleteServersTestJSON-2121090648-project Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: bf61ffac0e3143f6b44971158bd7a553 Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-DeleteServersTestJSON-2121090648-project Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:26.711822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '8106f539-061c-475e-a74f-ba331c8dc856'} Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:38:26.712636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. Jul 25 05:38:26.713963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:38:26.715134 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-237456f7-ebd6-44f4-aa19-b480cca9f615 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] Returning 404 to user: Instance 8106f539-061c-475e-a74f-ba331c8dc856 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:38:26.715134 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-237456f7-ebd6-44f4-aa19-b480cca9f615 tempest-DeleteServersTestJSON-2121090648 tempest-DeleteServersTestJSON-2121090648-project] 10.222.0.33 "GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856" status: 404 len: 111 microversion: 2.1 time: 0.040408 Jul 25 05:38:26.715134 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 83/155] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:26 2022] GET /compute/v2.1/servers/8106f539-061c-475e-a74f-ba331c8dc856 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:38:26.866036 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6cf7dee6-1580-4e67-badf-28acd072ac9c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:26.867499 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6cf7dee6-1580-4e67-badf-28acd072ac9c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:26.876825 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6cf7dee6-1580-4e67-badf-28acd072ac9c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:26.878252 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6cf7dee6-1580-4e67-badf-28acd072ac9c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:26.879030 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6cf7dee6-1580-4e67-badf-28acd072ac9c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:26.879624 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6cf7dee6-1580-4e67-badf-28acd072ac9c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:27.174786 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6cf7dee6-1580-4e67-badf-28acd072ac9c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:27.185550 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6cf7dee6-1580-4e67-badf-28acd072ac9c tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.324873 Jul 25 05:38:27.186448 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 73/156] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:26 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:28.218640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9032ab34-d88e-4335-a96a-9825228eef74 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:28.219241 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-9032ab34-d88e-4335-a96a-9825228eef74 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:28.231670 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9032ab34-d88e-4335-a96a-9825228eef74 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:28.234577 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9032ab34-d88e-4335-a96a-9825228eef74 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:28.239858 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9032ab34-d88e-4335-a96a-9825228eef74 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:28.241384 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9032ab34-d88e-4335-a96a-9825228eef74 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:28.634587 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9032ab34-d88e-4335-a96a-9825228eef74 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:28.650672 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-9032ab34-d88e-4335-a96a-9825228eef74 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.449899 Jul 25 05:38:28.651613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 84/157] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:28 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:29.668125 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b63afd95-29ca-4a95-8217-fb0973d28c7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:29.668894 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b63afd95-29ca-4a95-8217-fb0973d28c7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:29.683179 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b63afd95-29ca-4a95-8217-fb0973d28c7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:29.685070 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b63afd95-29ca-4a95-8217-fb0973d28c7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:29.708496 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b63afd95-29ca-4a95-8217-fb0973d28c7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:29.715610 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b63afd95-29ca-4a95-8217-fb0973d28c7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:30.052208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b63afd95-29ca-4a95-8217-fb0973d28c7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:30.070716 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b63afd95-29ca-4a95-8217-fb0973d28c7b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.406837 Jul 25 05:38:30.072379 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 74/158] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:29 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:31.089351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5af21129-6190-4849-b7bb-fac9f5b4d5eb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:31.090115 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5af21129-6190-4849-b7bb-fac9f5b4d5eb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:31.102748 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5af21129-6190-4849-b7bb-fac9f5b4d5eb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:31.103530 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5af21129-6190-4849-b7bb-fac9f5b4d5eb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:31.107404 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5af21129-6190-4849-b7bb-fac9f5b4d5eb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:31.107907 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5af21129-6190-4849-b7bb-fac9f5b4d5eb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:31.708966 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5af21129-6190-4849-b7bb-fac9f5b4d5eb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:31.718728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5af21129-6190-4849-b7bb-fac9f5b4d5eb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.633644 Jul 25 05:38:31.719285 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 85/159] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:31 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:32.738244 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-775ec395-93e1-401c-aed0-9f70ae12887a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:32.739666 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-775ec395-93e1-401c-aed0-9f70ae12887a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:32.752731 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-775ec395-93e1-401c-aed0-9f70ae12887a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:32.753541 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-775ec395-93e1-401c-aed0-9f70ae12887a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:32.754571 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-775ec395-93e1-401c-aed0-9f70ae12887a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:32.755394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-775ec395-93e1-401c-aed0-9f70ae12887a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:33.051766 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-775ec395-93e1-401c-aed0-9f70ae12887a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:33.059855 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-775ec395-93e1-401c-aed0-9f70ae12887a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.327643 Jul 25 05:38:33.060655 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 75/160] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:32 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:34.078557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6af3dc82-e59a-4310-bc42-2640420047fe tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:34.079291 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6af3dc82-e59a-4310-bc42-2640420047fe tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:34.085854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6af3dc82-e59a-4310-bc42-2640420047fe tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:34.086512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6af3dc82-e59a-4310-bc42-2640420047fe tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:34.088599 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6af3dc82-e59a-4310-bc42-2640420047fe tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:34.089071 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6af3dc82-e59a-4310-bc42-2640420047fe tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:34.270460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6af3dc82-e59a-4310-bc42-2640420047fe tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:34.284691 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6af3dc82-e59a-4310-bc42-2640420047fe tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.211326 Jul 25 05:38:34.286242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 86/161] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:34 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:35.304848 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8748bace-bbac-4269-9c83-f62330725479 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:35.305383 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8748bace-bbac-4269-9c83-f62330725479 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:35.315706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8748bace-bbac-4269-9c83-f62330725479 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:35.316115 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8748bace-bbac-4269-9c83-f62330725479 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:35.316925 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8748bace-bbac-4269-9c83-f62330725479 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:35.320516 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8748bace-bbac-4269-9c83-f62330725479 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:35.484112 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8748bace-bbac-4269-9c83-f62330725479 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:35.493095 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8748bace-bbac-4269-9c83-f62330725479 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.192583 Jul 25 05:38:35.493606 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 76/162] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:35 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:36.510868 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c7d58cd5-9c17-4287-962f-7d573c03245f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:36.511480 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c7d58cd5-9c17-4287-962f-7d573c03245f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:36.523814 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=38 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:36.527975 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c7d58cd5-9c17-4287-962f-7d573c03245f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:36.531026 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c7d58cd5-9c17-4287-962f-7d573c03245f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:36.532119 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c7d58cd5-9c17-4287-962f-7d573c03245f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:36.535966 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c7d58cd5-9c17-4287-962f-7d573c03245f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:36.765899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-c7d58cd5-9c17-4287-962f-7d573c03245f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:36.776264 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c7d58cd5-9c17-4287-962f-7d573c03245f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1522 microversion: 2.1 time: 0.269270 Jul 25 05:38:36.777202 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 87/163] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:36 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:37.793947 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-48750614-700c-48dd-9002-f05857235eee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:37.795451 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-48750614-700c-48dd-9002-f05857235eee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:37.822072 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:37.823893 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48750614-700c-48dd-9002-f05857235eee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:37.827037 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48750614-700c-48dd-9002-f05857235eee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:37.828090 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48750614-700c-48dd-9002-f05857235eee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:37.830368 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48750614-700c-48dd-9002-f05857235eee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:37.861057 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:38.066041 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-48750614-700c-48dd-9002-f05857235eee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:38.100394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-48750614-700c-48dd-9002-f05857235eee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1502 microversion: 2.1 time: 0.310414 Jul 25 05:38:38.101642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 77/164] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:37 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1502 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:38.117185 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7fec64d4-b633-4efd-aac7-0cbcf23a2947 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:38.117939 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7fec64d4-b633-4efd-aac7-0cbcf23a2947 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:38.131205 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7fec64d4-b633-4efd-aac7-0cbcf23a2947 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:38.131856 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7fec64d4-b633-4efd-aac7-0cbcf23a2947 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:38.134744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7fec64d4-b633-4efd-aac7-0cbcf23a2947 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:38.135400 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7fec64d4-b633-4efd-aac7-0cbcf23a2947 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:38.430716 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7fec64d4-b633-4efd-aac7-0cbcf23a2947 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:38.440982 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7fec64d4-b633-4efd-aac7-0cbcf23a2947 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1515 microversion: 2.1 time: 0.327677 Jul 25 05:38:38.442139 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 88/165] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:38 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1515 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:38.874942 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1074047c-6e15-452e-8ef5-f839e5e0c2c0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Action: 'create', calling method: .version_select at 0x7fcc84d11a60>, body: {"keypair": {"name": "tempest-keypair-2124194878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPB6xyeW/To2raKhjXJOi8DLj0bYuNPfxiVW0OhhcmZRid5XVn/IUXv2kdYa3Rw/VzJwoy6XCrBlckAcodZqk4rM2xjNXm+fuqyLt7fcj1IkrM2PsL3ZYpySJVKWNQQnJw=="}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:38:38.906798 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-1074047c-6e15-452e-8ef5-f839e5e0c2c0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Getting quotas for project f0b7d41e75df46f28cebff70c16d4750. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:38:38.912055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-1074047c-6e15-452e-8ef5-f839e5e0c2c0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Getting quotas for user c1ae82a1862048cb9038b7c76190da8a and project f0b7d41e75df46f28cebff70c16d4750. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:38:38.966668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1074047c-6e15-452e-8ef5-f839e5e0c2c0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.314897 Jul 25 05:38:38.967511 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 78/166] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 25 05:38:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:38:40.734367 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-356146725", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e8a2b36-0a33-4763-b71a-50bb1209bd57"}], "security_groups": [{"name": "tempest-securitygroup--1663327477"}], "key_name": "tempest-keypair-2124194878", "user_data": "}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:38:42.347374 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2b0a0345-cab0-4ec7-b7ee-29fb32c4d9a2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:38:42.350350 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2b0a0345-cab0-4ec7-b7ee-29fb32c4d9a2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:42.359207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b0a0345-cab0-4ec7-b7ee-29fb32c4d9a2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:42.359879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b0a0345-cab0-4ec7-b7ee-29fb32c4d9a2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:42.361121 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b0a0345-cab0-4ec7-b7ee-29fb32c4d9a2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:42.361771 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b0a0345-cab0-4ec7-b7ee-29fb32c4d9a2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:42.391312 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-2b0a0345-cab0-4ec7-b7ee-29fb32c4d9a2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lazy-loading 'flavor' on Instance uuid 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:38:42.521146 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2b0a0345-cab0-4ec7-b7ee-29fb32c4d9a2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "POST /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7/action" status: 200 len: 32 microversion: 2.1 time: 0.174762 Jul 25 05:38:42.522100 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 79/167] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:38:42 2022] POST /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 05:38:42.533962 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f6ae0f44-0f7c-4dd5-afb2-043e73433f38 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:42.534771 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f6ae0f44-0f7c-4dd5-afb2-043e73433f38 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:42.544246 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f6ae0f44-0f7c-4dd5-afb2-043e73433f38 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:42.545173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f6ae0f44-0f7c-4dd5-afb2-043e73433f38 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:42.546084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f6ae0f44-0f7c-4dd5-afb2-043e73433f38 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:42.547438 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f6ae0f44-0f7c-4dd5-afb2-043e73433f38 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:42.882658 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f6ae0f44-0f7c-4dd5-afb2-043e73433f38 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:42.894189 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f6ae0f44-0f7c-4dd5-afb2-043e73433f38 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.364407 Jul 25 05:38:42.897535 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 80/168] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:42 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:43.914792 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e299e828-6ce7-4afc-9708-6bc156dfadb2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:43.915399 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e299e828-6ce7-4afc-9708-6bc156dfadb2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:43.923074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e299e828-6ce7-4afc-9708-6bc156dfadb2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:43.923538 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e299e828-6ce7-4afc-9708-6bc156dfadb2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:43.924339 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e299e828-6ce7-4afc-9708-6bc156dfadb2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:43.924995 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e299e828-6ce7-4afc-9708-6bc156dfadb2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:44.072901 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e299e828-6ce7-4afc-9708-6bc156dfadb2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:44.081984 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e299e828-6ce7-4afc-9708-6bc156dfadb2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.171226 Jul 25 05:38:44.082626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 81/169] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:43 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:38:45.015170 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.network.neutron [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] validate_networks() for [('9e8a2b36-0a33-4763-b71a-50bb1209bd57', None, None, None, None, None)] {{(pid=124467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:38:45.103679 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-66619702-e311-41e0-9d6b-b4aff3cde4af tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:45.105434 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-66619702-e311-41e0-9d6b-b4aff3cde4af tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:45.117329 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66619702-e311-41e0-9d6b-b4aff3cde4af tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:45.119996 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66619702-e311-41e0-9d6b-b4aff3cde4af tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:45.120827 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66619702-e311-41e0-9d6b-b4aff3cde4af tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:45.121578 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66619702-e311-41e0-9d6b-b4aff3cde4af tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:45.362770 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-66619702-e311-41e0-9d6b-b4aff3cde4af tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:45.373376 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-66619702-e311-41e0-9d6b-b4aff3cde4af tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.276109 Jul 25 05:38:45.376100 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 82/170] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:45 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:45.544678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Flavor limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:38:45.545172 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Image limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:38:45.545651 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Flavor pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:38:45.546052 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Image pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:38:45.546459 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:38:45.556711 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:45.557195 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:45.557992 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:45.558440 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:45.578775 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Getting quotas for project f0b7d41e75df46f28cebff70c16d4750. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:38:45.583415 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Getting quotas for user c1ae82a1862048cb9038b7c76190da8a and project f0b7d41e75df46f28cebff70c16d4750. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:38:45.595272 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Going to run 1 instances... {{(pid=124467) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:38:45.597771 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:38:45.650808 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-37be9b61-e388-492e-b97f-b7525e3ca20c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.926711 Jul 25 05:38:45.656524 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 89/171] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:38:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 4928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:38:45.662899 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a9dc75aa-dae0-4945-97f9-3597e750130a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:45.663516 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a9dc75aa-dae0-4945-97f9-3597e750130a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:45.718913 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a9dc75aa-dae0-4945-97f9-3597e750130a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:45.725725 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a9dc75aa-dae0-4945-97f9-3597e750130a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1237 microversion: 2.1 time: 0.067081 Jul 25 05:38:45.726289 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 83/172] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:45 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:46.391463 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-91fcdf07-005a-440d-9e5b-03432f85ced3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:46.392074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-91fcdf07-005a-440d-9e5b-03432f85ced3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:46.398125 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-91fcdf07-005a-440d-9e5b-03432f85ced3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:46.398571 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-91fcdf07-005a-440d-9e5b-03432f85ced3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:46.399320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-91fcdf07-005a-440d-9e5b-03432f85ced3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:46.399756 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-91fcdf07-005a-440d-9e5b-03432f85ced3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:46.529579 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-91fcdf07-005a-440d-9e5b-03432f85ced3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:46.536857 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-91fcdf07-005a-440d-9e5b-03432f85ced3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.149940 Jul 25 05:38:46.537436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 90/173] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:46 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:46.743192 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b0dfcbd2-5b26-4dec-bad3-c6a7f5fab5ba tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:46.743738 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b0dfcbd2-5b26-4dec-bad3-c6a7f5fab5ba tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:46.751476 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0dfcbd2-5b26-4dec-bad3-c6a7f5fab5ba tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:46.751937 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0dfcbd2-5b26-4dec-bad3-c6a7f5fab5ba tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:46.752717 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0dfcbd2-5b26-4dec-bad3-c6a7f5fab5ba tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:46.753168 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0dfcbd2-5b26-4dec-bad3-c6a7f5fab5ba tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:46.814618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b0dfcbd2-5b26-4dec-bad3-c6a7f5fab5ba tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:46.822545 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b0dfcbd2-5b26-4dec-bad3-c6a7f5fab5ba tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1241 microversion: 2.1 time: 0.083270 Jul 25 05:38:46.823100 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 84/174] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:46 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:47.554413 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cb8c6336-2ebe-421a-88dc-0ed91a2ed53a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:47.555063 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-cb8c6336-2ebe-421a-88dc-0ed91a2ed53a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:47.561942 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cb8c6336-2ebe-421a-88dc-0ed91a2ed53a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:47.562395 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cb8c6336-2ebe-421a-88dc-0ed91a2ed53a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:47.563155 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cb8c6336-2ebe-421a-88dc-0ed91a2ed53a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:47.563596 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cb8c6336-2ebe-421a-88dc-0ed91a2ed53a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:47.695792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cb8c6336-2ebe-421a-88dc-0ed91a2ed53a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:47.703887 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cb8c6336-2ebe-421a-88dc-0ed91a2ed53a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.153275 Jul 25 05:38:47.704462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 91/175] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:47 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:47.839899 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-06c824a8-8461-44a8-a435-89fdeab38f00 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:47.840538 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-06c824a8-8461-44a8-a435-89fdeab38f00 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:47.847135 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06c824a8-8461-44a8-a435-89fdeab38f00 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:47.847588 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06c824a8-8461-44a8-a435-89fdeab38f00 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:47.848349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06c824a8-8461-44a8-a435-89fdeab38f00 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:47.848795 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06c824a8-8461-44a8-a435-89fdeab38f00 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:47.912578 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-06c824a8-8461-44a8-a435-89fdeab38f00 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:47.919992 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-06c824a8-8461-44a8-a435-89fdeab38f00 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1241 microversion: 2.1 time: 0.083901 Jul 25 05:38:47.920591 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 85/176] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:47 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:48.721421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-846ed830-d88f-479b-87c4-1e722de7a40f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:48.722063 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-846ed830-d88f-479b-87c4-1e722de7a40f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:48.728123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846ed830-d88f-479b-87c4-1e722de7a40f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:48.728577 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846ed830-d88f-479b-87c4-1e722de7a40f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:48.729397 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846ed830-d88f-479b-87c4-1e722de7a40f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:48.729858 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846ed830-d88f-479b-87c4-1e722de7a40f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:48.858974 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-846ed830-d88f-479b-87c4-1e722de7a40f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:48.866263 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-846ed830-d88f-479b-87c4-1e722de7a40f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.148693 Jul 25 05:38:48.866821 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 92/177] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:48 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:48.937216 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-32c82331-6ff5-4ad5-86f7-e1080be44663 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:48.937927 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-32c82331-6ff5-4ad5-86f7-e1080be44663 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:48.944529 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-32c82331-6ff5-4ad5-86f7-e1080be44663 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:48.945021 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-32c82331-6ff5-4ad5-86f7-e1080be44663 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:48.945790 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-32c82331-6ff5-4ad5-86f7-e1080be44663 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:48.946236 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-32c82331-6ff5-4ad5-86f7-e1080be44663 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:49.013290 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-32c82331-6ff5-4ad5-86f7-e1080be44663 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:49.021550 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-32c82331-6ff5-4ad5-86f7-e1080be44663 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1289 microversion: 2.1 time: 0.088591 Jul 25 05:38:49.022119 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 86/178] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:48 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:49.883653 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-846eef3a-cae8-45ce-8d42-6da8a9980a97 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:49.884894 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-846eef3a-cae8-45ce-8d42-6da8a9980a97 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:49.894184 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846eef3a-cae8-45ce-8d42-6da8a9980a97 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:49.894644 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846eef3a-cae8-45ce-8d42-6da8a9980a97 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:49.895415 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846eef3a-cae8-45ce-8d42-6da8a9980a97 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:49.895852 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846eef3a-cae8-45ce-8d42-6da8a9980a97 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:50.040241 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a0cfc604-de6c-40d5-bcd2-b1c12cd04bae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:50.040988 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a0cfc604-de6c-40d5-bcd2-b1c12cd04bae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:50.048695 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0cfc604-de6c-40d5-bcd2-b1c12cd04bae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:50.049513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0cfc604-de6c-40d5-bcd2-b1c12cd04bae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:50.050590 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0cfc604-de6c-40d5-bcd2-b1c12cd04bae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:50.051137 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0cfc604-de6c-40d5-bcd2-b1c12cd04bae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:50.150056 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a0cfc604-de6c-40d5-bcd2-b1c12cd04bae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:50.168459 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a0cfc604-de6c-40d5-bcd2-b1c12cd04bae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1295 microversion: 2.1 time: 0.132581 Jul 25 05:38:50.169228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 87/179] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:50 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1295 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:38:50.176128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-846eef3a-cae8-45ce-8d42-6da8a9980a97 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:50.184363 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-846eef3a-cae8-45ce-8d42-6da8a9980a97 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.304420 Jul 25 05:38:50.185163 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 93/180] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:49 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:51.122783 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-edaceacd-e375-40e6-a210-58bb8f9e10aa req-5933e1f9-678b-47ca-9f1e-d7fc4b0e2759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4943e050-a915-4850-8e01-9590c5fcde77", "tag": "95d850ae-eaa4-4645-9536-93c90734b2d8"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:38:51.148487 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-edaceacd-e375-40e6-a210-58bb8f9e10aa req-5933e1f9-678b-47ca-9f1e-d7fc4b0e2759 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:51.148981 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-edaceacd-e375-40e6-a210-58bb8f9e10aa req-5933e1f9-678b-47ca-9f1e-d7fc4b0e2759 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:51.165049 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-edaceacd-e375-40e6-a210-58bb8f9e10aa req-5933e1f9-678b-47ca-9f1e-d7fc4b0e2759 service nova] Creating event network-changed:95d850ae-eaa4-4645-9536-93c90734b2d8 for instance 4943e050-a915-4850-8e01-9590c5fcde77 on hv-cinder-85083 Jul 25 05:38:51.174382 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-edaceacd-e375-40e6-a210-58bb8f9e10aa req-5933e1f9-678b-47ca-9f1e-d7fc4b0e2759 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055057 Jul 25 05:38:51.175792 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 88/181] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:38:51.187395 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-aeb4b25f-5ee1-49d3-8dac-0b46b93dd048 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:51.188382 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-aeb4b25f-5ee1-49d3-8dac-0b46b93dd048 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:51.207200 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2d31e199-d903-46ce-8c43-a443403a7272 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:51.207919 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2d31e199-d903-46ce-8c43-a443403a7272 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:51.212535 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeb4b25f-5ee1-49d3-8dac-0b46b93dd048 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:51.213024 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeb4b25f-5ee1-49d3-8dac-0b46b93dd048 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:51.213812 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeb4b25f-5ee1-49d3-8dac-0b46b93dd048 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:51.214278 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeb4b25f-5ee1-49d3-8dac-0b46b93dd048 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:51.238713 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2d31e199-d903-46ce-8c43-a443403a7272 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:51.241082 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2d31e199-d903-46ce-8c43-a443403a7272 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:51.242207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2d31e199-d903-46ce-8c43-a443403a7272 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:51.242820 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2d31e199-d903-46ce-8c43-a443403a7272 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:51.580371 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2d31e199-d903-46ce-8c43-a443403a7272 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:51.585470 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-aeb4b25f-5ee1-49d3-8dac-0b46b93dd048 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:51.593702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-aeb4b25f-5ee1-49d3-8dac-0b46b93dd048 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1363 microversion: 2.1 time: 0.411487 Jul 25 05:38:51.594423 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 94/182] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:51 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1363 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:51.595298 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2d31e199-d903-46ce-8c43-a443403a7272 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.392982 Jul 25 05:38:51.595861 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 89/183] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:51 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:52.612103 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1297f20a-e40a-4f3e-8a10-cf8bfa1fbb5b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:52.612726 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1297f20a-e40a-4f3e-8a10-cf8bfa1fbb5b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:52.616689 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bbb5b703-14d6-4cd7-acfd-134923253b18 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:52.617623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bbb5b703-14d6-4cd7-acfd-134923253b18 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:52.619125 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1297f20a-e40a-4f3e-8a10-cf8bfa1fbb5b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:52.619581 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1297f20a-e40a-4f3e-8a10-cf8bfa1fbb5b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:52.620353 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1297f20a-e40a-4f3e-8a10-cf8bfa1fbb5b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:52.620811 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1297f20a-e40a-4f3e-8a10-cf8bfa1fbb5b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:52.626553 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbb5b703-14d6-4cd7-acfd-134923253b18 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:52.627031 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbb5b703-14d6-4cd7-acfd-134923253b18 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:52.628373 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbb5b703-14d6-4cd7-acfd-134923253b18 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:52.629176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbb5b703-14d6-4cd7-acfd-134923253b18 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:52.839459 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1297f20a-e40a-4f3e-8a10-cf8bfa1fbb5b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:52.840197 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bbb5b703-14d6-4cd7-acfd-134923253b18 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:52.844193 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1297f20a-e40a-4f3e-8a10-cf8bfa1fbb5b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1363 microversion: 2.1 time: 0.237046 Jul 25 05:38:52.844796 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 95/184] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:52 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:52.856229 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bbb5b703-14d6-4cd7-acfd-134923253b18 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.248550 Jul 25 05:38:52.856932 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 90/185] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:52 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:38:53.861292 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-32c407cf-fea4-46fc-8a6f-26de5f24f4a6 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:53.862711 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-32c407cf-fea4-46fc-8a6f-26de5f24f4a6 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:53.870965 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-32c407cf-fea4-46fc-8a6f-26de5f24f4a6 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:53.871734 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-32c407cf-fea4-46fc-8a6f-26de5f24f4a6 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:53.872756 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-32c407cf-fea4-46fc-8a6f-26de5f24f4a6 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:53.873995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-32c407cf-fea4-46fc-8a6f-26de5f24f4a6 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:53.875556 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1d321c63-f375-4ca9-a6af-40cf108f1053 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:53.876966 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1d321c63-f375-4ca9-a6af-40cf108f1053 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:53.885086 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1d321c63-f375-4ca9-a6af-40cf108f1053 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:53.886076 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1d321c63-f375-4ca9-a6af-40cf108f1053 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:53.887123 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1d321c63-f375-4ca9-a6af-40cf108f1053 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:53.887870 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1d321c63-f375-4ca9-a6af-40cf108f1053 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:54.102456 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-32c407cf-fea4-46fc-8a6f-26de5f24f4a6 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:54.106251 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1d321c63-f375-4ca9-a6af-40cf108f1053 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:54.112183 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-32c407cf-fea4-46fc-8a6f-26de5f24f4a6 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1363 microversion: 2.1 time: 0.254933 Jul 25 05:38:54.112761 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 96/186] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:53 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:54.115914 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1d321c63-f375-4ca9-a6af-40cf108f1053 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.246734 Jul 25 05:38:54.117020 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 91/187] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:53 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:38:55.132324 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9e435677-7310-4972-af54-148815a8a87e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:55.136065 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9e435677-7310-4972-af54-148815a8a87e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:55.139976 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8a9ee4ad-5440-4cba-8944-07156f1b231a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:55.141780 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8a9ee4ad-5440-4cba-8944-07156f1b231a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:55.153213 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8a9ee4ad-5440-4cba-8944-07156f1b231a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:55.156556 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9e435677-7310-4972-af54-148815a8a87e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:55.157168 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8a9ee4ad-5440-4cba-8944-07156f1b231a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:55.158217 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8a9ee4ad-5440-4cba-8944-07156f1b231a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:55.158657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8a9ee4ad-5440-4cba-8944-07156f1b231a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:55.160552 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9e435677-7310-4972-af54-148815a8a87e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:55.161450 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9e435677-7310-4972-af54-148815a8a87e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:55.162058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9e435677-7310-4972-af54-148815a8a87e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:55.383019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8a9ee4ad-5440-4cba-8944-07156f1b231a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:55.393247 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8a9ee4ad-5440-4cba-8944-07156f1b231a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1363 microversion: 2.1 time: 0.267340 Jul 25 05:38:55.394043 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 97/188] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:55 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:38:55.397592 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9e435677-7310-4972-af54-148815a8a87e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:55.405852 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9e435677-7310-4972-af54-148815a8a87e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.277361 Jul 25 05:38:55.406425 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 92/189] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:55 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:56.410821 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-53736a35-ca60-4375-a5bc-d0cd04bdc6a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:56.411942 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-53736a35-ca60-4375-a5bc-d0cd04bdc6a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:56.414930 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=2 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:56.415574 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=6 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:56.419750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-53736a35-ca60-4375-a5bc-d0cd04bdc6a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:56.420563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-53736a35-ca60-4375-a5bc-d0cd04bdc6a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:56.421355 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-53736a35-ca60-4375-a5bc-d0cd04bdc6a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:56.421814 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-53736a35-ca60-4375-a5bc-d0cd04bdc6a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:56.424222 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9b335832-2fb2-4097-bf63-735169aa57df tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:56.426188 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9b335832-2fb2-4097-bf63-735169aa57df tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:56.427492 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=84 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:56.428577 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=6 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:56.437269 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9b335832-2fb2-4097-bf63-735169aa57df tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:56.437763 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9b335832-2fb2-4097-bf63-735169aa57df tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:56.438599 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9b335832-2fb2-4097-bf63-735169aa57df tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:56.439047 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9b335832-2fb2-4097-bf63-735169aa57df tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:56.627691 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-53736a35-ca60-4375-a5bc-d0cd04bdc6a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:56.634762 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9b335832-2fb2-4097-bf63-735169aa57df tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:56.637491 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-53736a35-ca60-4375-a5bc-d0cd04bdc6a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1363 microversion: 2.1 time: 0.230509 Jul 25 05:38:56.648222 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9b335832-2fb2-4097-bf63-735169aa57df tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.225858 Jul 25 05:38:56.648222 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 93/190] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:56 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:38:56.648650 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 98/191] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:56 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:57.655885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7fdb33eb-b184-4395-b628-00cf76256780 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:57.656485 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7fdb33eb-b184-4395-b628-00cf76256780 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:57.661680 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1ac21de9-9993-42f1-8d76-a96b06a214c0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:57.662287 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1ac21de9-9993-42f1-8d76-a96b06a214c0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:57.662995 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7fdb33eb-b184-4395-b628-00cf76256780 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:57.663444 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7fdb33eb-b184-4395-b628-00cf76256780 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:57.664201 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7fdb33eb-b184-4395-b628-00cf76256780 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:57.664638 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7fdb33eb-b184-4395-b628-00cf76256780 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:57.668181 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1ac21de9-9993-42f1-8d76-a96b06a214c0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:57.668632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1ac21de9-9993-42f1-8d76-a96b06a214c0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:57.669415 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1ac21de9-9993-42f1-8d76-a96b06a214c0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:57.670575 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1ac21de9-9993-42f1-8d76-a96b06a214c0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:57.862910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7fdb33eb-b184-4395-b628-00cf76256780 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:57.865169 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:57.866416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1ac21de9-9993-42f1-8d76-a96b06a214c0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:57.871568 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7fdb33eb-b184-4395-b628-00cf76256780 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1363 microversion: 2.1 time: 0.220065 Jul 25 05:38:57.872142 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 94/192] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:57 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:38:57.874070 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1ac21de9-9993-42f1-8d76-a96b06a214c0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.216166 Jul 25 05:38:57.874623 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 99/193] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:57 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:38:58.889771 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-91b010c8-b345-47ed-aaf2-9d65ec13916e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:58.890379 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-91b010c8-b345-47ed-aaf2-9d65ec13916e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:58.891342 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c436d1fa-0132-4965-a5d4-96cb2c44eac9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:38:58.891958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c436d1fa-0132-4965-a5d4-96cb2c44eac9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:38:58.897426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91b010c8-b345-47ed-aaf2-9d65ec13916e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:58.897885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91b010c8-b345-47ed-aaf2-9d65ec13916e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:58.907693 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91b010c8-b345-47ed-aaf2-9d65ec13916e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:58.907693 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91b010c8-b345-47ed-aaf2-9d65ec13916e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:58.908769 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c436d1fa-0132-4965-a5d4-96cb2c44eac9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:58.909426 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c436d1fa-0132-4965-a5d4-96cb2c44eac9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:58.910227 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c436d1fa-0132-4965-a5d4-96cb2c44eac9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:38:58.910696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c436d1fa-0132-4965-a5d4-96cb2c44eac9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:38:59.089149 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-c436d1fa-0132-4965-a5d4-96cb2c44eac9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:59.096790 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c436d1fa-0132-4965-a5d4-96cb2c44eac9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.210033 Jul 25 05:38:59.097386 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 100/194] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:58 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:38:59.174832 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-91b010c8-b345-47ed-aaf2-9d65ec13916e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:38:59.182479 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-91b010c8-b345-47ed-aaf2-9d65ec13916e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1363 microversion: 2.1 time: 0.297863 Jul 25 05:38:59.183050 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 95/195] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:38:58 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:00.116531 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4adea8ad-3736-42ef-9504-0fd5179f4ef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:00.117305 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4adea8ad-3736-42ef-9504-0fd5179f4ef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:00.124895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4adea8ad-3736-42ef-9504-0fd5179f4ef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:00.125673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4adea8ad-3736-42ef-9504-0fd5179f4ef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:00.126633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4adea8ad-3736-42ef-9504-0fd5179f4ef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:00.127240 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4adea8ad-3736-42ef-9504-0fd5179f4ef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:00.202298 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3cb61128-3e90-4b57-8998-f47502cc6443 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:00.203256 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3cb61128-3e90-4b57-8998-f47502cc6443 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:00.214662 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3cb61128-3e90-4b57-8998-f47502cc6443 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:00.215391 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3cb61128-3e90-4b57-8998-f47502cc6443 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:00.216179 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3cb61128-3e90-4b57-8998-f47502cc6443 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:00.216633 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3cb61128-3e90-4b57-8998-f47502cc6443 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:00.363016 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4adea8ad-3736-42ef-9504-0fd5179f4ef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:00.371046 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4adea8ad-3736-42ef-9504-0fd5179f4ef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.260262 Jul 25 05:39:00.371632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 101/196] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:00 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:00.376901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-2745382a-994c-4635-8a42-bf77c8b800f8 req-48951688-8e1e-425e-99c2-6297359871a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4943e050-a915-4850-8e01-9590c5fcde77", "name": "network-vif-plugged", "status": "completed", "tag": "95d850ae-eaa4-4645-9536-93c90734b2d8"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:00.386350 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-2745382a-994c-4635-8a42-bf77c8b800f8 req-48951688-8e1e-425e-99c2-6297359871a4 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:00.386805 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-2745382a-994c-4635-8a42-bf77c8b800f8 req-48951688-8e1e-425e-99c2-6297359871a4 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:00.400567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-2745382a-994c-4635-8a42-bf77c8b800f8 req-48951688-8e1e-425e-99c2-6297359871a4 service nova] Creating event network-vif-plugged:95d850ae-eaa4-4645-9536-93c90734b2d8 for instance 4943e050-a915-4850-8e01-9590c5fcde77 on hv-cinder-85083 Jul 25 05:39:00.406468 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-2745382a-994c-4635-8a42-bf77c8b800f8 req-48951688-8e1e-425e-99c2-6297359871a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033462 Jul 25 05:39:00.407109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 102/197] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:00.412741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3cb61128-3e90-4b57-8998-f47502cc6443 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:00.421977 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3cb61128-3e90-4b57-8998-f47502cc6443 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1363 microversion: 2.1 time: 0.224307 Jul 25 05:39:00.422382 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 96/198] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:00 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:39:01.388151 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-806bf4b6-034c-4b59-be60-b47df402d13b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:01.393087 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-806bf4b6-034c-4b59-be60-b47df402d13b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:01.399483 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-806bf4b6-034c-4b59-be60-b47df402d13b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:01.399944 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-806bf4b6-034c-4b59-be60-b47df402d13b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:01.400721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-806bf4b6-034c-4b59-be60-b47df402d13b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:01.401272 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-806bf4b6-034c-4b59-be60-b47df402d13b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:01.440291 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5e38fc25-e053-4a4c-8566-798b42499efe tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:01.441247 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5e38fc25-e053-4a4c-8566-798b42499efe tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:01.448721 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e38fc25-e053-4a4c-8566-798b42499efe tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:01.449220 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e38fc25-e053-4a4c-8566-798b42499efe tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:01.450762 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e38fc25-e053-4a4c-8566-798b42499efe tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:01.451422 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e38fc25-e053-4a4c-8566-798b42499efe tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:01.593444 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-806bf4b6-034c-4b59-be60-b47df402d13b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:01.601646 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-806bf4b6-034c-4b59-be60-b47df402d13b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.217664 Jul 25 05:39:01.602575 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 103/199] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:01 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:01.628190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5e38fc25-e053-4a4c-8566-798b42499efe tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:01.636542 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5e38fc25-e053-4a4c-8566-798b42499efe tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1363 microversion: 2.1 time: 0.200544 Jul 25 05:39:01.637139 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 97/200] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:01 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:39:02.622196 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ada175bb-763f-42bb-86d2-16f59c586fc7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:02.622196 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ada175bb-763f-42bb-86d2-16f59c586fc7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:02.625590 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ada175bb-763f-42bb-86d2-16f59c586fc7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:02.626275 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ada175bb-763f-42bb-86d2-16f59c586fc7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:02.627231 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ada175bb-763f-42bb-86d2-16f59c586fc7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:02.627693 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ada175bb-763f-42bb-86d2-16f59c586fc7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:02.655527 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e894dd11-d6aa-42bb-9c0a-06420d861f3e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:02.657013 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e894dd11-d6aa-42bb-9c0a-06420d861f3e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:02.669512 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e894dd11-d6aa-42bb-9c0a-06420d861f3e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:02.670381 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e894dd11-d6aa-42bb-9c0a-06420d861f3e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:02.671516 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e894dd11-d6aa-42bb-9c0a-06420d861f3e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:02.672639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e894dd11-d6aa-42bb-9c0a-06420d861f3e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:02.952667 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ada175bb-763f-42bb-86d2-16f59c586fc7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:02.956588 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e894dd11-d6aa-42bb-9c0a-06420d861f3e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:02.961043 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ada175bb-763f-42bb-86d2-16f59c586fc7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.346948 Jul 25 05:39:02.961633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 104/201] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:02 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:02.964227 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e894dd11-d6aa-42bb-9c0a-06420d861f3e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1363 microversion: 2.1 time: 0.313940 Jul 25 05:39:02.964817 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 98/202] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:02 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:39:03.978646 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-25ff21b7-3b7c-4ef6-af70-a1774ee10856 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:03.979261 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-25ff21b7-3b7c-4ef6-af70-a1774ee10856 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:03.981530 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-89383243-7e2b-453f-9dae-6801b5234628 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:03.982160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-89383243-7e2b-453f-9dae-6801b5234628 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:03.985575 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-25ff21b7-3b7c-4ef6-af70-a1774ee10856 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:03.986578 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-25ff21b7-3b7c-4ef6-af70-a1774ee10856 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:03.987291 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-25ff21b7-3b7c-4ef6-af70-a1774ee10856 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:03.987723 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-25ff21b7-3b7c-4ef6-af70-a1774ee10856 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:03.989293 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-89383243-7e2b-453f-9dae-6801b5234628 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:03.989753 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-89383243-7e2b-453f-9dae-6801b5234628 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:03.990622 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-89383243-7e2b-453f-9dae-6801b5234628 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:03.991048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-89383243-7e2b-453f-9dae-6801b5234628 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:04.191388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-89383243-7e2b-453f-9dae-6801b5234628 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:04.195048 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-25ff21b7-3b7c-4ef6-af70-a1774ee10856 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:04.198913 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-89383243-7e2b-453f-9dae-6801b5234628 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1549 microversion: 2.1 time: 0.221295 Jul 25 05:39:04.199487 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 99/203] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:03 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1549 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:39:04.204387 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-25ff21b7-3b7c-4ef6-af70-a1774ee10856 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.229589 Jul 25 05:39:04.206648 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 105/204] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:03 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:04.220608 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-feed7a9f-6202-4d70-bfbf-d9f79cbd259f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:04.221251 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-feed7a9f-6202-4d70-bfbf-d9f79cbd259f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:04.227325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-feed7a9f-6202-4d70-bfbf-d9f79cbd259f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:04.227781 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-feed7a9f-6202-4d70-bfbf-d9f79cbd259f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:04.228549 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-feed7a9f-6202-4d70-bfbf-d9f79cbd259f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:04.229028 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-feed7a9f-6202-4d70-bfbf-d9f79cbd259f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:04.306808 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-feed7a9f-6202-4d70-bfbf-d9f79cbd259f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090614 Jul 25 05:39:04.307347 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 100/205] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 25 05:39:04 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:05.223053 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4f854373-29bb-4226-8cbf-4684dc633438 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:05.223668 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4f854373-29bb-4226-8cbf-4684dc633438 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:05.229769 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f854373-29bb-4226-8cbf-4684dc633438 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:05.230218 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f854373-29bb-4226-8cbf-4684dc633438 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:05.230978 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f854373-29bb-4226-8cbf-4684dc633438 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:05.231416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f854373-29bb-4226-8cbf-4684dc633438 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:05.402843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8f7c6290-159c-461d-9e8a-d06575e5bd67 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:05.403387 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8f7c6290-159c-461d-9e8a-d06575e5bd67 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:05.411060 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f7c6290-159c-461d-9e8a-d06575e5bd67 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:05.411516 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f7c6290-159c-461d-9e8a-d06575e5bd67 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:05.412285 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f7c6290-159c-461d-9e8a-d06575e5bd67 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:05.412730 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f7c6290-159c-461d-9e8a-d06575e5bd67 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:05.431631 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4f854373-29bb-4226-8cbf-4684dc633438 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:05.436508 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8f7c6290-159c-461d-9e8a-d06575e5bd67 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/ips" status: 200 len: 149 microversion: 2.1 time: 0.038035 Jul 25 05:39:05.437113 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 101/206] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 25 05:39:05 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:05.445552 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4f854373-29bb-4226-8cbf-4684dc633438 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.227084 Jul 25 05:39:05.446270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 106/207] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:05 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:05.701824 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-c4e3fc48-0a3a-4a8e-9621-c61166e789f9 req-3f33edf5-aa25-46b1-949c-ec087238569c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4943e050-a915-4850-8e01-9590c5fcde77", "tag": "95d850ae-eaa4-4645-9536-93c90734b2d8"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:05.715376 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-c4e3fc48-0a3a-4a8e-9621-c61166e789f9 req-3f33edf5-aa25-46b1-949c-ec087238569c service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:05.716204 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-c4e3fc48-0a3a-4a8e-9621-c61166e789f9 req-3f33edf5-aa25-46b1-949c-ec087238569c service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:05.732808 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-c4e3fc48-0a3a-4a8e-9621-c61166e789f9 req-3f33edf5-aa25-46b1-949c-ec087238569c service nova] Creating event network-changed:95d850ae-eaa4-4645-9536-93c90734b2d8 for instance 4943e050-a915-4850-8e01-9590c5fcde77 on hv-cinder-85083 Jul 25 05:39:05.742726 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-c4e3fc48-0a3a-4a8e-9621-c61166e789f9 req-3f33edf5-aa25-46b1-949c-ec087238569c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044205 Jul 25 05:39:05.744046 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 102/208] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:06.463153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-44c8a42c-d8bf-419c-8a76-46bd23c40725 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:06.464347 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-44c8a42c-d8bf-419c-8a76-46bd23c40725 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:06.471118 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-44c8a42c-d8bf-419c-8a76-46bd23c40725 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:06.471764 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-44c8a42c-d8bf-419c-8a76-46bd23c40725 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:06.472545 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-44c8a42c-d8bf-419c-8a76-46bd23c40725 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:06.473018 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-44c8a42c-d8bf-419c-8a76-46bd23c40725 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:06.685687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-44c8a42c-d8bf-419c-8a76-46bd23c40725 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:06.697603 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-44c8a42c-d8bf-419c-8a76-46bd23c40725 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.237750 Jul 25 05:39:06.698567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 107/209] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:06 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:07.717597 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c3294005-17d4-446f-87dc-ce0ff93ec585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:07.718960 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c3294005-17d4-446f-87dc-ce0ff93ec585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:07.726563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3294005-17d4-446f-87dc-ce0ff93ec585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:07.726924 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3294005-17d4-446f-87dc-ce0ff93ec585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:07.727703 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3294005-17d4-446f-87dc-ce0ff93ec585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:07.728298 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3294005-17d4-446f-87dc-ce0ff93ec585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:07.882599 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d2825803-0f97-4d15-beab-695f1cc067c8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "408b6643-16f3-4433-b331-4698bb311caf"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:07.883750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d2825803-0f97-4d15-beab-695f1cc067c8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:07.885982 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:07.889076 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c3294005-17d4-446f-87dc-ce0ff93ec585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:07.891558 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2825803-0f97-4d15-beab-695f1cc067c8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:07.892659 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2825803-0f97-4d15-beab-695f1cc067c8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:07.893540 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2825803-0f97-4d15-beab-695f1cc067c8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:07.893980 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2825803-0f97-4d15-beab-695f1cc067c8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:07.897840 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c3294005-17d4-446f-87dc-ce0ff93ec585 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.185714 Jul 25 05:39:07.898418 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 103/210] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:07 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:08.248714 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d2825803-0f97-4d15-beab-695f1cc067c8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369949 Jul 25 05:39:08.251072 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 108/211] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:39:07 2022] POST /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:08.914980 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8795d361-b3e7-4181-8b73-b2298a97cf6f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:08.915507 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8795d361-b3e7-4181-8b73-b2298a97cf6f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:08.918015 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:08.924060 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8795d361-b3e7-4181-8b73-b2298a97cf6f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:08.924750 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8795d361-b3e7-4181-8b73-b2298a97cf6f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:08.925488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8795d361-b3e7-4181-8b73-b2298a97cf6f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:08.925927 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8795d361-b3e7-4181-8b73-b2298a97cf6f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:09.067330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8795d361-b3e7-4181-8b73-b2298a97cf6f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:09.076123 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8795d361-b3e7-4181-8b73-b2298a97cf6f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.165184 Jul 25 05:39:09.076699 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 104/212] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:08 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:10.097010 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-021299fa-82f3-4112-b961-859503b8a68a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:10.097756 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-021299fa-82f3-4112-b961-859503b8a68a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:10.104363 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-021299fa-82f3-4112-b961-859503b8a68a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:10.104834 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-021299fa-82f3-4112-b961-859503b8a68a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:10.105601 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-021299fa-82f3-4112-b961-859503b8a68a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:10.106040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-021299fa-82f3-4112-b961-859503b8a68a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:10.238462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-021299fa-82f3-4112-b961-859503b8a68a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:10.245817 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-021299fa-82f3-4112-b961-859503b8a68a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.155406 Jul 25 05:39:10.246377 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 109/213] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:10 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:11.262514 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-54b827e6-38b8-40a4-9d85-34cda5d9a618 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:11.263124 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-54b827e6-38b8-40a4-9d85-34cda5d9a618 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:11.270136 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54b827e6-38b8-40a4-9d85-34cda5d9a618 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:11.270588 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54b827e6-38b8-40a4-9d85-34cda5d9a618 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:11.271349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54b827e6-38b8-40a4-9d85-34cda5d9a618 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:11.271787 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54b827e6-38b8-40a4-9d85-34cda5d9a618 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:11.401521 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-54b827e6-38b8-40a4-9d85-34cda5d9a618 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:11.409171 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-54b827e6-38b8-40a4-9d85-34cda5d9a618 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.150247 Jul 25 05:39:11.409747 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 105/214] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:11 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:12.426753 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-90f8be87-dbf9-446f-98bc-d8d4f63a86ee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:12.427373 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-90f8be87-dbf9-446f-98bc-d8d4f63a86ee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:12.434487 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90f8be87-dbf9-446f-98bc-d8d4f63a86ee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:12.434487 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90f8be87-dbf9-446f-98bc-d8d4f63a86ee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:12.435248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90f8be87-dbf9-446f-98bc-d8d4f63a86ee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:12.435971 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90f8be87-dbf9-446f-98bc-d8d4f63a86ee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:12.595057 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-90f8be87-dbf9-446f-98bc-d8d4f63a86ee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:12.607425 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-90f8be87-dbf9-446f-98bc-d8d4f63a86ee tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.185323 Jul 25 05:39:12.608721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 110/215] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:12 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:13.626420 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c8d2a626-c09f-4968-b49d-c53e741bb106 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:13.628267 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c8d2a626-c09f-4968-b49d-c53e741bb106 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:13.637271 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8d2a626-c09f-4968-b49d-c53e741bb106 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:13.637944 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8d2a626-c09f-4968-b49d-c53e741bb106 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:13.638732 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8d2a626-c09f-4968-b49d-c53e741bb106 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:13.639332 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8d2a626-c09f-4968-b49d-c53e741bb106 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:13.783141 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c8d2a626-c09f-4968-b49d-c53e741bb106 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:13.790575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c8d2a626-c09f-4968-b49d-c53e741bb106 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.168751 Jul 25 05:39:13.791355 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 106/216] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:13 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:14.808208 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3f02b7f1-a9c6-4aca-baf0-0cd673450e3a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:14.808827 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3f02b7f1-a9c6-4aca-baf0-0cd673450e3a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:14.822420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3f02b7f1-a9c6-4aca-baf0-0cd673450e3a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:14.822868 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3f02b7f1-a9c6-4aca-baf0-0cd673450e3a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:14.823664 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3f02b7f1-a9c6-4aca-baf0-0cd673450e3a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:14.824122 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3f02b7f1-a9c6-4aca-baf0-0cd673450e3a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:14.961804 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3f02b7f1-a9c6-4aca-baf0-0cd673450e3a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:14.970646 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3f02b7f1-a9c6-4aca-baf0-0cd673450e3a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1501 microversion: 2.1 time: 0.166010 Jul 25 05:39:14.971264 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 111/217] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:14 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:14.988959 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-16f6d498-6b4f-4e64-b74a-7f7f167f1677 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29795c17-e324-40db-8de0-4382d5be36ed"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:14.990102 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-16f6d498-6b4f-4e64-b74a-7f7f167f1677 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:14.996639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-16f6d498-6b4f-4e64-b74a-7f7f167f1677 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:14.997130 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-16f6d498-6b4f-4e64-b74a-7f7f167f1677 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:14.997935 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-16f6d498-6b4f-4e64-b74a-7f7f167f1677 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:14.998383 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-16f6d498-6b4f-4e64-b74a-7f7f167f1677 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:15.021040 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-16f6d498-6b4f-4e64-b74a-7f7f167f1677 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] HTTP exception thrown: Cannot 'attach_volume' instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 while it is in vm_state rescued Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-16f6d498-6b4f-4e64-b74a-7f7f167f1677 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Request method failure captured: Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: POST /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7/os-volume_attachments HTTP/1.1 Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 74 Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iwGlH116eE9G9ee7Lm8JbUWiAPDu8YN3efd6rqcOJFGqiqIvx-Z4bkyaOgt73L_olv3J7RnJmzhVyekt9wWkZaL54kuiNpYanVEwj12N03q2Ucu7IGSA5oKP8wI9kg26x-Wl7rEFaGGhyw8DEAlUPLkVAIgJLPtlKNbsgMEc5Hn6Y8 Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: c782b01e8e484fe8bb710aeddc0192d1 Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:39:15.023173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c782b01e8e484fe8bb710aeddc0192d1"}]}] Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c782b01e8e484fe8bb710aeddc0192d1 Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-ServerRescueNegativeTestJSON-1264352499-project Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 37c1bb8500f74013b073febfc0d96217 Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1264352499-project Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {"volumeAttachment": {"volumeId": "29795c17-e324-40db-8de0-4382d5be36ed"}} Jul 25 05:39:15.024611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Cannot 'attach_volume' instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 while it is in vm_state rescued Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'server_id': '12aaf07a-d8f0-46c4-98f9-ba47ee257fa7', 'body': {'volumeAttachment': {'volumeId': '29795c17-e324-40db-8de0-4382d5be36ed'}}} Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:39:15.025513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 while it is in vm_state rescued Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:39:15.026833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:39:15.028055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:39:15.028055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:39:15.028055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 while it is in vm_state rescued Jul 25 05:39:15.028055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:39:15.028055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-16f6d498-6b4f-4e64-b74a-7f7f167f1677 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Returning 409 to user: Cannot 'attach_volume' instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 while it is in vm_state rescued {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:39:15.028055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-16f6d498-6b4f-4e64-b74a-7f7f167f1677 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "POST /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040529 Jul 25 05:39:15.028055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 107/218] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:39:14 2022] POST /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 05:39:15.033570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-eba9c182-57b0-485e-b70b-5d81836dc200 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:15.034128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-eba9c182-57b0-485e-b70b-5d81836dc200 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:15.040913 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eba9c182-57b0-485e-b70b-5d81836dc200 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:15.041361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eba9c182-57b0-485e-b70b-5d81836dc200 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:15.042110 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eba9c182-57b0-485e-b70b-5d81836dc200 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:15.042541 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eba9c182-57b0-485e-b70b-5d81836dc200 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:15.117204 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-eba9c182-57b0-485e-b70b-5d81836dc200 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "POST /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7/action" status: 202 len: 0 microversion: 2.1 time: 0.087207 Jul 25 05:39:15.118586 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 112/219] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:39:15 2022] POST /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:39:15.128088 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a3d1ae69-3f84-4ce2-8568-e20ed01020c4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:15.129607 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a3d1ae69-3f84-4ce2-8568-e20ed01020c4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:15.136994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a3d1ae69-3f84-4ce2-8568-e20ed01020c4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:15.137626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a3d1ae69-3f84-4ce2-8568-e20ed01020c4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:15.138411 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a3d1ae69-3f84-4ce2-8568-e20ed01020c4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:15.138856 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a3d1ae69-3f84-4ce2-8568-e20ed01020c4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:15.283572 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a3d1ae69-3f84-4ce2-8568-e20ed01020c4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:15.291245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a3d1ae69-3f84-4ce2-8568-e20ed01020c4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1509 microversion: 2.1 time: 0.167838 Jul 25 05:39:15.291802 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 108/220] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:15 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:15.876966 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4cb80c68-8575-47ee-a40e-f599d50d4c51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: .version_select at 0x7fcc845a35e0>, body: {"keypair": {"name": "tempest-keypair-504096076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhjAGn1GGBCZ4qtOkB5c+hsSvjgu3h5S4cODZS7cRrUmrndKpF30uPZTNNu2yT/8JjzepCejNCuaic9vGPoK5MO28C7ajZC2U0hpJ2Bwl0o8SPgx0HGU5V9UqtDMr2bnA=="}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:15.895862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-4cb80c68-8575-47ee-a40e-f599d50d4c51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:39:15.900135 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-4cb80c68-8575-47ee-a40e-f599d50d4c51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for user 69f3276517de4f889dddd3180436ede9 and project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:39:15.936577 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4cb80c68-8575-47ee-a40e-f599d50d4c51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064754 Jul 25 05:39:15.940188 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 113/221] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 25 05:39:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:16.309769 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-44eed1fc-e6bd-4004-9c3e-a7f581ba4f86 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:16.313360 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-44eed1fc-e6bd-4004-9c3e-a7f581ba4f86 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:16.320487 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-44eed1fc-e6bd-4004-9c3e-a7f581ba4f86 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:16.320989 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-44eed1fc-e6bd-4004-9c3e-a7f581ba4f86 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:16.321767 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-44eed1fc-e6bd-4004-9c3e-a7f581ba4f86 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:16.322211 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-44eed1fc-e6bd-4004-9c3e-a7f581ba4f86 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:16.563358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-44eed1fc-e6bd-4004-9c3e-a7f581ba4f86 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:16.572390 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-44eed1fc-e6bd-4004-9c3e-a7f581ba4f86 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1509 microversion: 2.1 time: 0.266522 Jul 25 05:39:16.578405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 109/222] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:16 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:17.569023 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-703184643", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fec420c3-be12-4a0c-92d9-7ad0ead1f91c"}], "security_groups": [{"name": "tempest-securitygroup--2053678526"}], "key_name": "tempest-keypair-504096076", "user_data": "}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:17.589506 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-de1b3eb1-e2ec-4f11-9077-ebd710b54c71 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:17.590129 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-de1b3eb1-e2ec-4f11-9077-ebd710b54c71 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:17.601448 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de1b3eb1-e2ec-4f11-9077-ebd710b54c71 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:17.602995 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de1b3eb1-e2ec-4f11-9077-ebd710b54c71 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:17.603125 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de1b3eb1-e2ec-4f11-9077-ebd710b54c71 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:17.603519 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de1b3eb1-e2ec-4f11-9077-ebd710b54c71 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:17.780620 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.network.neutron [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] validate_networks() for [('fec420c3-be12-4a0c-92d9-7ad0ead1f91c', None, None, None, None, None)] {{(pid=124467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:39:17.837495 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-de1b3eb1-e2ec-4f11-9077-ebd710b54c71 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:17.848380 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-de1b3eb1-e2ec-4f11-9077-ebd710b54c71 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1509 microversion: 2.1 time: 0.261536 Jul 25 05:39:17.849566 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 110/223] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:17 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:18.271806 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Flavor limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:39:18.272333 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Image limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:39:18.273071 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Flavor pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:39:18.273552 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Image pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:39:18.274034 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:39:18.283302 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:18.283957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:18.284749 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:18.286034 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:18.293066 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:18.307652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:39:18.315771 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for user 69f3276517de4f889dddd3180436ede9 and project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:39:18.330619 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Going to run 1 instances... {{(pid=124467) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:39:18.333989 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:39:18.380363 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5a151bb3-4cd1-4f58-b347-7232502e2a26 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.816328 Jul 25 05:39:18.381240 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 114/224] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:39:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:39:18.401599 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-95731d48-beb0-4b05-a53f-95b1cc168750 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:18.418186 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-95731d48-beb0-4b05-a53f-95b1cc168750 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:18.506411 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-95731d48-beb0-4b05-a53f-95b1cc168750 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:18.523858 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-95731d48-beb0-4b05-a53f-95b1cc168750 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1240 microversion: 2.1 time: 0.136228 Jul 25 05:39:18.524561 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 111/225] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:18 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1240 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:18.867140 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f5796494-8be3-4d45-ae44-7830c8f17208 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:18.871588 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f5796494-8be3-4d45-ae44-7830c8f17208 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:18.892041 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f5796494-8be3-4d45-ae44-7830c8f17208 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:18.892480 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f5796494-8be3-4d45-ae44-7830c8f17208 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:18.893351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f5796494-8be3-4d45-ae44-7830c8f17208 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:18.893978 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f5796494-8be3-4d45-ae44-7830c8f17208 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:19.071149 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f5796494-8be3-4d45-ae44-7830c8f17208 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:19.079293 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f5796494-8be3-4d45-ae44-7830c8f17208 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1515 microversion: 2.1 time: 0.216328 Jul 25 05:39:19.080099 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 115/226] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:18 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:19.540832 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9bd3b145-b72e-4408-927c-1465b70e0deb tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:19.541452 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9bd3b145-b72e-4408-927c-1465b70e0deb tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:19.557798 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9bd3b145-b72e-4408-927c-1465b70e0deb tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:19.561523 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9bd3b145-b72e-4408-927c-1465b70e0deb tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:19.562651 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9bd3b145-b72e-4408-927c-1465b70e0deb tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:19.563250 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9bd3b145-b72e-4408-927c-1465b70e0deb tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:19.635664 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9bd3b145-b72e-4408-927c-1465b70e0deb tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:19.644352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9bd3b145-b72e-4408-927c-1465b70e0deb tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1292 microversion: 2.1 time: 0.106871 Jul 25 05:39:19.645478 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 112/227] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:19 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1292 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:20.611253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f386819b-985c-4393-adf8-59bf74321e65 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Action: 'create', calling method: .version_select at 0x7fcc845bfb80>, body: {"keypair": {"name": "tempest-keypair-408725491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOiqUEacAdXOwzgbe27xNDhoreX6Im1sKKLg3yv71gJVWw+lf7vzbpi+MnYEYSYt24A+ePb9V7ktVG0AJGiB7M5VxksT6q/C7eJ0yNNJc59F5KDsucPv+me5+5dEcAUQw=="}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:20.633916 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-f386819b-985c-4393-adf8-59bf74321e65 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Getting quotas for project c782b01e8e484fe8bb710aeddc0192d1. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:39:20.638392 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-f386819b-985c-4393-adf8-59bf74321e65 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Getting quotas for user 37c1bb8500f74013b073febfc0d96217 and project c782b01e8e484fe8bb710aeddc0192d1. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:39:20.667522 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a46d91b3-99b7-4449-a6a7-29ff00a9df2d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:20.668355 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a46d91b3-99b7-4449-a6a7-29ff00a9df2d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:20.677050 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f386819b-985c-4393-adf8-59bf74321e65 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070681 Jul 25 05:39:20.677322 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a46d91b3-99b7-4449-a6a7-29ff00a9df2d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:20.678011 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a46d91b3-99b7-4449-a6a7-29ff00a9df2d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:20.678624 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 116/228] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 25 05:39:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:20.684588 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a46d91b3-99b7-4449-a6a7-29ff00a9df2d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:20.685365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a46d91b3-99b7-4449-a6a7-29ff00a9df2d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:20.985401 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a46d91b3-99b7-4449-a6a7-29ff00a9df2d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:20.996362 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a46d91b3-99b7-4449-a6a7-29ff00a9df2d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1366 microversion: 2.1 time: 0.337620 Jul 25 05:39:20.998310 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 113/229] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:20 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:22.017077 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e5aff0c3-d1cc-4d36-b61d-089430ae958a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:22.017725 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e5aff0c3-d1cc-4d36-b61d-089430ae958a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:22.032124 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e5aff0c3-d1cc-4d36-b61d-089430ae958a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:22.035791 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e5aff0c3-d1cc-4d36-b61d-089430ae958a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:22.037371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e5aff0c3-d1cc-4d36-b61d-089430ae958a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:22.040576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e5aff0c3-d1cc-4d36-b61d-089430ae958a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:22.309476 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-31947fc5-5f09-41cc-a6b2-ad6d5ceb4b04 req-55aaf63d-a3bf-4dcd-9ee9-af95c1860165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5529050b-f2cf-4a8d-a44a-aeeff80f9a44", "tag": "a17feb40-f712-434b-ab5d-3a419f924bb1"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:22.328418 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-31947fc5-5f09-41cc-a6b2-ad6d5ceb4b04 req-55aaf63d-a3bf-4dcd-9ee9-af95c1860165 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:22.331441 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-31947fc5-5f09-41cc-a6b2-ad6d5ceb4b04 req-55aaf63d-a3bf-4dcd-9ee9-af95c1860165 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:22.369940 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:22.372319 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-31947fc5-5f09-41cc-a6b2-ad6d5ceb4b04 req-55aaf63d-a3bf-4dcd-9ee9-af95c1860165 service nova] Creating event network-changed:a17feb40-f712-434b-ab5d-3a419f924bb1 for instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 on hv-cinder-85083 Jul 25 05:39:22.399478 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-31947fc5-5f09-41cc-a6b2-ad6d5ceb4b04 req-55aaf63d-a3bf-4dcd-9ee9-af95c1860165 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093681 Jul 25 05:39:22.400530 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 114/230] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:22.927750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e5aff0c3-d1cc-4d36-b61d-089430ae958a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:22.939134 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e5aff0c3-d1cc-4d36-b61d-089430ae958a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1366 microversion: 2.1 time: 0.927376 Jul 25 05:39:22.950869 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 117/231] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:22 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1366 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:23.634158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-377058970", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "networks": [{"uuid": "bc35280f-d3fa-4a8e-8f13-e8e0a7a52950"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:23.702848 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] validate_networks() for [('bc35280f-d3fa-4a8e-8f13-e8e0a7a52950', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:39:23.956703 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-679cd382-7240-4033-9afb-6573dee8a8f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:23.959063 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-679cd382-7240-4033-9afb-6573dee8a8f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:23.967045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-679cd382-7240-4033-9afb-6573dee8a8f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:23.967809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-679cd382-7240-4033-9afb-6573dee8a8f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:23.968768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-679cd382-7240-4033-9afb-6573dee8a8f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:23.969411 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-679cd382-7240-4033-9afb-6573dee8a8f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:24.304138 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-679cd382-7240-4033-9afb-6573dee8a8f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:24.315726 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-679cd382-7240-4033-9afb-6573dee8a8f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1366 microversion: 2.1 time: 0.363723 Jul 25 05:39:24.316560 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 118/232] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:23 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:24.428099 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-593222556", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0be019a4-499c-47a6-88b3-5437178c588d"}], "security_groups": [{"name": "tempest-securitygroup--1859453139"}], "key_name": "tempest-keypair-408725491", "user_data": "}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:24.548320 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:39:24.549275 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:39:24.550062 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:39:24.550752 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:39:24.552116 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:39:24.565046 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:24.565859 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:24.566906 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:24.567582 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:24.592154 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Getting quotas for project 213b3114e35d4016b3169364760edb17. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:39:24.597984 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Getting quotas for user ce0944d760224239bd16aa0981db0eec and project 213b3114e35d4016b3169364760edb17. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:39:24.614409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:39:24.616857 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:39:24.674599 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.network.neutron [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] validate_networks() for [('0be019a4-499c-47a6-88b3-5437178c588d', None, None, None, None, None)] {{(pid=124467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:39:24.709573 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-953f743e-3bfd-4a34-bea9-d35a101ebb35 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.080288 Jul 25 05:39:24.711459 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 115/233] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:39:24.726149 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d585bb78-3a76-4d53-ad5f-6a270e99894a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:24.727186 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d585bb78-3a76-4d53-ad5f-6a270e99894a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:24.932341 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d585bb78-3a76-4d53-ad5f-6a270e99894a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:24.940984 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d585bb78-3a76-4d53-ad5f-6a270e99894a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1218 microversion: 2.1 time: 0.220586 Jul 25 05:39:24.942998 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 116/234] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:24 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1218 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:25.334348 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b388b797-82ab-44d1-bf30-d278d843fc13 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:25.335203 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b388b797-82ab-44d1-bf30-d278d843fc13 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:25.342656 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b388b797-82ab-44d1-bf30-d278d843fc13 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:25.343316 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b388b797-82ab-44d1-bf30-d278d843fc13 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:25.344413 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b388b797-82ab-44d1-bf30-d278d843fc13 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:25.345049 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b388b797-82ab-44d1-bf30-d278d843fc13 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:25.571865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Flavor limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:39:25.572349 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Image limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:39:25.572908 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Flavor pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:39:25.573432 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Image pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:39:25.573922 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:39:25.595591 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:25.596599 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:25.598004 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:25.600631 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:25.651312 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Getting quotas for project c782b01e8e484fe8bb710aeddc0192d1. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:39:25.663620 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Getting quotas for user 37c1bb8500f74013b073febfc0d96217 and project c782b01e8e484fe8bb710aeddc0192d1. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:39:25.686573 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Going to run 1 instances... {{(pid=124467) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:39:25.689453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:39:25.737200 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b388b797-82ab-44d1-bf30-d278d843fc13 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:25.747309 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b388b797-82ab-44d1-bf30-d278d843fc13 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1366 microversion: 2.1 time: 0.418039 Jul 25 05:39:25.751526 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 117/235] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:25 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:25.776882 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7aaaec84-115c-4d86-a23e-13bdfbbeddb9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.354955 Jul 25 05:39:25.778022 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 119/236] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:39:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:39:25.790211 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2108b87f-c9ed-4a9d-bcaa-5bcf03929ede tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:25.791650 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2108b87f-c9ed-4a9d-bcaa-5bcf03929ede tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:25.882263 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2108b87f-c9ed-4a9d-bcaa-5bcf03929ede tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:25.895703 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2108b87f-c9ed-4a9d-bcaa-5bcf03929ede tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1244 microversion: 2.1 time: 0.106914 Jul 25 05:39:25.895939 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 118/237] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:25 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1244 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:25.963580 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-80a04bfd-bf12-4d55-95b3-4fb13a51c464 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:25.967349 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-80a04bfd-bf12-4d55-95b3-4fb13a51c464 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:25.986196 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80a04bfd-bf12-4d55-95b3-4fb13a51c464 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:25.986804 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80a04bfd-bf12-4d55-95b3-4fb13a51c464 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:25.990095 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80a04bfd-bf12-4d55-95b3-4fb13a51c464 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:25.991943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80a04bfd-bf12-4d55-95b3-4fb13a51c464 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:26.130588 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-80a04bfd-bf12-4d55-95b3-4fb13a51c464 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:26.139937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-80a04bfd-bf12-4d55-95b3-4fb13a51c464 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1270 microversion: 2.1 time: 0.183660 Jul 25 05:39:26.140950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 120/238] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:25 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:26.769814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c03bf916-a574-498a-8034-b8f1dee09810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:26.771218 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c03bf916-a574-498a-8034-b8f1dee09810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:26.781460 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c03bf916-a574-498a-8034-b8f1dee09810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:26.781883 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c03bf916-a574-498a-8034-b8f1dee09810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:26.782986 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c03bf916-a574-498a-8034-b8f1dee09810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:26.783776 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c03bf916-a574-498a-8034-b8f1dee09810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:26.921745 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9d22b90e-b0d9-4b3b-a51d-c9e7d90c8baa tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:26.924517 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-9d22b90e-b0d9-4b3b-a51d-c9e7d90c8baa tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:26.944582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9d22b90e-b0d9-4b3b-a51d-c9e7d90c8baa tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:26.945148 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9d22b90e-b0d9-4b3b-a51d-c9e7d90c8baa tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:26.946040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9d22b90e-b0d9-4b3b-a51d-c9e7d90c8baa tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:26.946973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9d22b90e-b0d9-4b3b-a51d-c9e7d90c8baa tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:27.327069 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9d22b90e-b0d9-4b3b-a51d-c9e7d90c8baa tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:27.337140 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-9d22b90e-b0d9-4b3b-a51d-c9e7d90c8baa tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1296 microversion: 2.1 time: 0.425222 Jul 25 05:39:27.345110 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 121/239] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:26 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1296 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:27.351240 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d097b69f-f421-4b66-a764-f54a66779dfd tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:27.355221 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d097b69f-f421-4b66-a764-f54a66779dfd tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:27.361391 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c03bf916-a574-498a-8034-b8f1dee09810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:27.367472 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d097b69f-f421-4b66-a764-f54a66779dfd tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:27.374416 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c03bf916-a574-498a-8034-b8f1dee09810 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1366 microversion: 2.1 time: 0.609143 Jul 25 05:39:27.375004 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 119/240] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:26 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1366 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:27.375508 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d097b69f-f421-4b66-a764-f54a66779dfd tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:27.377478 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d097b69f-f421-4b66-a764-f54a66779dfd tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:27.378410 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d097b69f-f421-4b66-a764-f54a66779dfd tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:27.584486 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d097b69f-f421-4b66-a764-f54a66779dfd tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:27.597988 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d097b69f-f421-4b66-a764-f54a66779dfd tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1276 microversion: 2.1 time: 0.248892 Jul 25 05:39:27.599162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 122/241] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:27 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:28.362258 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a04fe84c-0337-42bd-895b-eee95c9ea20e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:28.363712 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a04fe84c-0337-42bd-895b-eee95c9ea20e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:28.372911 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a04fe84c-0337-42bd-895b-eee95c9ea20e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:28.377709 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a04fe84c-0337-42bd-895b-eee95c9ea20e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:28.387424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a04fe84c-0337-42bd-895b-eee95c9ea20e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:28.388052 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a04fe84c-0337-42bd-895b-eee95c9ea20e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:28.392593 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e02e14af-180f-405b-b248-402cf141ce71 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:28.393616 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e02e14af-180f-405b-b248-402cf141ce71 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:28.406541 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e02e14af-180f-405b-b248-402cf141ce71 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:28.408256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e02e14af-180f-405b-b248-402cf141ce71 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:28.409742 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e02e14af-180f-405b-b248-402cf141ce71 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:28.413108 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e02e14af-180f-405b-b248-402cf141ce71 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:28.583723 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a04fe84c-0337-42bd-895b-eee95c9ea20e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:28.593813 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a04fe84c-0337-42bd-895b-eee95c9ea20e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1302 microversion: 2.1 time: 0.235357 Jul 25 05:39:28.595548 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 120/242] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:28 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1302 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:28.617988 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-35e9ec9e-41b1-4cb3-b755-129ba07c914b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:28.618621 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-35e9ec9e-41b1-4cb3-b755-129ba07c914b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:28.625194 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-35e9ec9e-41b1-4cb3-b755-129ba07c914b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:28.625842 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-35e9ec9e-41b1-4cb3-b755-129ba07c914b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:28.628174 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-35e9ec9e-41b1-4cb3-b755-129ba07c914b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:28.631890 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-35e9ec9e-41b1-4cb3-b755-129ba07c914b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:28.796478 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e02e14af-180f-405b-b248-402cf141ce71 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:28.810421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e02e14af-180f-405b-b248-402cf141ce71 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1366 microversion: 2.1 time: 0.421267 Jul 25 05:39:28.822354 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 123/243] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:28 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:28.952391 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-35e9ec9e-41b1-4cb3-b755-129ba07c914b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:28.971709 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-35e9ec9e-41b1-4cb3-b755-129ba07c914b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.358429 Jul 25 05:39:28.974764 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 121/244] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:28 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:39:29.618550 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-065291d2-59a7-47a7-be4d-4c92568b1f07 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:29.620641 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-065291d2-59a7-47a7-be4d-4c92568b1f07 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:29.633012 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-065291d2-59a7-47a7-be4d-4c92568b1f07 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:29.633744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-065291d2-59a7-47a7-be4d-4c92568b1f07 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:29.634913 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-065291d2-59a7-47a7-be4d-4c92568b1f07 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:29.635568 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-065291d2-59a7-47a7-be4d-4c92568b1f07 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:29.829596 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0d1c2959-48da-4633-b4d2-3b99aeac4d55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:29.830414 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0d1c2959-48da-4633-b4d2-3b99aeac4d55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:29.840002 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0d1c2959-48da-4633-b4d2-3b99aeac4d55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:29.840913 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0d1c2959-48da-4633-b4d2-3b99aeac4d55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:29.841870 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0d1c2959-48da-4633-b4d2-3b99aeac4d55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:29.842433 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0d1c2959-48da-4633-b4d2-3b99aeac4d55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:29.890331 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-065291d2-59a7-47a7-be4d-4c92568b1f07 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:29.908345 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-065291d2-59a7-47a7-be4d-4c92568b1f07 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1370 microversion: 2.1 time: 0.299395 Jul 25 05:39:29.922102 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 124/245] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:29 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:29.990895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1927aac7-4e55-473e-898d-fa3edf04a69b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:29.992509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1927aac7-4e55-473e-898d-fa3edf04a69b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:29.999643 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1927aac7-4e55-473e-898d-fa3edf04a69b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:30.000798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1927aac7-4e55-473e-898d-fa3edf04a69b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:30.001818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1927aac7-4e55-473e-898d-fa3edf04a69b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:30.002970 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1927aac7-4e55-473e-898d-fa3edf04a69b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:30.077683 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0d1c2959-48da-4633-b4d2-3b99aeac4d55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:30.096684 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0d1c2959-48da-4633-b4d2-3b99aeac4d55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1366 microversion: 2.1 time: 0.272702 Jul 25 05:39:30.099333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 122/246] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:29 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:30.204743 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1927aac7-4e55-473e-898d-fa3edf04a69b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:30.216232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1927aac7-4e55-473e-898d-fa3edf04a69b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.230683 Jul 25 05:39:30.217149 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 125/247] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:29 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:30.902699 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-ed917f56-665d-4746-880c-f9fbf7c097c4 req-0f90da77-5f36-4213-b582-710240f6dcda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5529050b-f2cf-4a8d-a44a-aeeff80f9a44", "name": "network-vif-plugged", "status": "completed", "tag": "a17feb40-f712-434b-ab5d-3a419f924bb1"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:30.914659 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ed917f56-665d-4746-880c-f9fbf7c097c4 req-0f90da77-5f36-4213-b582-710240f6dcda service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:30.915341 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ed917f56-665d-4746-880c-f9fbf7c097c4 req-0f90da77-5f36-4213-b582-710240f6dcda service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:30.929291 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f177ec23-8ed8-439b-8c6a-62fea265d2fb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:30.931087 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f177ec23-8ed8-439b-8c6a-62fea265d2fb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:30.936031 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-ed917f56-665d-4746-880c-f9fbf7c097c4 req-0f90da77-5f36-4213-b582-710240f6dcda service nova] Creating event network-vif-plugged:a17feb40-f712-434b-ab5d-3a419f924bb1 for instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 on hv-cinder-85083 Jul 25 05:39:30.942162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f177ec23-8ed8-439b-8c6a-62fea265d2fb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:30.942881 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f177ec23-8ed8-439b-8c6a-62fea265d2fb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:30.943681 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f177ec23-8ed8-439b-8c6a-62fea265d2fb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:30.945273 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f177ec23-8ed8-439b-8c6a-62fea265d2fb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:30.945719 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-ed917f56-665d-4746-880c-f9fbf7c097c4 req-0f90da77-5f36-4213-b582-710240f6dcda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048170 Jul 25 05:39:30.946701 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 123/248] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:31.117247 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ca8ad3cc-7eb2-4831-96e8-ff9a964c2940 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:31.117967 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ca8ad3cc-7eb2-4831-96e8-ff9a964c2940 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:31.131470 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ca8ad3cc-7eb2-4831-96e8-ff9a964c2940 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:31.131931 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ca8ad3cc-7eb2-4831-96e8-ff9a964c2940 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:31.132954 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ca8ad3cc-7eb2-4831-96e8-ff9a964c2940 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:31.133392 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ca8ad3cc-7eb2-4831-96e8-ff9a964c2940 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:31.545754 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f177ec23-8ed8-439b-8c6a-62fea265d2fb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:31.553387 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f177ec23-8ed8-439b-8c6a-62fea265d2fb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1370 microversion: 2.1 time: 0.632009 Jul 25 05:39:31.562875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 126/249] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:30 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1370 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:39:31.568481 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1a564905-8d80-47c1-bd2b-160d92c2f155 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:31.569349 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1a564905-8d80-47c1-bd2b-160d92c2f155 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:31.576880 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1a564905-8d80-47c1-bd2b-160d92c2f155 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:31.577542 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1a564905-8d80-47c1-bd2b-160d92c2f155 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:31.578452 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1a564905-8d80-47c1-bd2b-160d92c2f155 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:31.579041 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1a564905-8d80-47c1-bd2b-160d92c2f155 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:31.761218 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ca8ad3cc-7eb2-4831-96e8-ff9a964c2940 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:31.788683 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ca8ad3cc-7eb2-4831-96e8-ff9a964c2940 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1366 microversion: 2.1 time: 0.676724 Jul 25 05:39:31.789662 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 124/250] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:31 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1366 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:31.977569 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1a564905-8d80-47c1-bd2b-160d92c2f155 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:32.009845 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1a564905-8d80-47c1-bd2b-160d92c2f155 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.445579 Jul 25 05:39:32.014034 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 127/251] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:31 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:32.058583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8cab66d6-0d8e-4203-8bd9-58a104223cdd tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Action: 'create', calling method: .version_select at 0x7fcc84e38040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1985723475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5w0QtJCtVpelKemQDfL1S6r4p9MLF/32DU4g3rf91y6o61a0Wmd4sUyaxwoKPj3HIZoCz6ygBVxQ4YnXi3rMozVeE97s1E+cdgausvfrB9VduAGxbs/zy+F9mN3cl3CA=="}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:32.074751 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-8cab66d6-0d8e-4203-8bd9-58a104223cdd tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Getting quotas for project ee638472255a48d2bdffa17a4ff22339. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:39:32.078791 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-8cab66d6-0d8e-4203-8bd9-58a104223cdd tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Getting quotas for user 1f815f111bf74739969736acea131927 and project ee638472255a48d2bdffa17a4ff22339. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:39:32.104818 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8cab66d6-0d8e-4203-8bd9-58a104223cdd tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.242520 Jul 25 05:39:32.105708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 125/252] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 25 05:39:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:32.570049 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2fc36fe8-57d1-4628-ab61-65e848160522 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:32.571147 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2fc36fe8-57d1-4628-ab61-65e848160522 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:32.593334 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2fc36fe8-57d1-4628-ab61-65e848160522 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:32.594324 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2fc36fe8-57d1-4628-ab61-65e848160522 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:32.596146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2fc36fe8-57d1-4628-ab61-65e848160522 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:32.598441 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2fc36fe8-57d1-4628-ab61-65e848160522 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:32.786168 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-610a5d67-b8dd-40c0-a096-69f18da00f2c req-564050f7-4c79-4cfb-8586-1d9c396d3902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd0febc-671b-4a39-9dbf-d71d6eb11b32", "tag": "9d91bc86-6db7-4b09-b3c9-3958dd762034"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:32.816976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-610a5d67-b8dd-40c0-a096-69f18da00f2c req-564050f7-4c79-4cfb-8586-1d9c396d3902 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:32.818970 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-610a5d67-b8dd-40c0-a096-69f18da00f2c req-564050f7-4c79-4cfb-8586-1d9c396d3902 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:32.859067 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-610a5d67-b8dd-40c0-a096-69f18da00f2c req-564050f7-4c79-4cfb-8586-1d9c396d3902 service nova] Creating event network-changed:9d91bc86-6db7-4b09-b3c9-3958dd762034 for instance edd0febc-671b-4a39-9dbf-d71d6eb11b32 on hv-cinder-85083 Jul 25 05:39:32.872714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-610a5d67-b8dd-40c0-a096-69f18da00f2c req-564050f7-4c79-4cfb-8586-1d9c396d3902 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115111 Jul 25 05:39:32.873690 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 126/253] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:32.884126 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f4f67dbb-7761-431e-84cc-0c5d9245bbd2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:32.884842 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f4f67dbb-7761-431e-84cc-0c5d9245bbd2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:32.893853 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f4f67dbb-7761-431e-84cc-0c5d9245bbd2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:32.896126 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f4f67dbb-7761-431e-84cc-0c5d9245bbd2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:32.897429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f4f67dbb-7761-431e-84cc-0c5d9245bbd2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:32.898027 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f4f67dbb-7761-431e-84cc-0c5d9245bbd2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:32.999438 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2fc36fe8-57d1-4628-ab61-65e848160522 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:33.012176 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2fc36fe8-57d1-4628-ab61-65e848160522 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1370 microversion: 2.1 time: 0.446046 Jul 25 05:39:33.012770 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 128/254] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:32 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1370 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:33.033302 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6bbd1a96-2e4d-49a4-b8ed-7ff1a7f1e065 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:33.034132 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6bbd1a96-2e4d-49a4-b8ed-7ff1a7f1e065 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:33.042524 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6bbd1a96-2e4d-49a4-b8ed-7ff1a7f1e065 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:33.043245 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6bbd1a96-2e4d-49a4-b8ed-7ff1a7f1e065 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:33.044217 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6bbd1a96-2e4d-49a4-b8ed-7ff1a7f1e065 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:33.050938 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6bbd1a96-2e4d-49a4-b8ed-7ff1a7f1e065 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:33.210804 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f4f67dbb-7761-431e-84cc-0c5d9245bbd2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:33.219731 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f4f67dbb-7761-431e-84cc-0c5d9245bbd2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1366 microversion: 2.1 time: 0.343364 Jul 25 05:39:33.224930 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 127/255] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:32 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:33.304499 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6bbd1a96-2e4d-49a4-b8ed-7ff1a7f1e065 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:33.321757 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6bbd1a96-2e4d-49a4-b8ed-7ff1a7f1e065 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.294749 Jul 25 05:39:33.322274 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 129/256] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:33 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:34.033275 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-20da1370-82c1-45c4-9247-3a59cecbd5f5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:34.056425 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-20da1370-82c1-45c4-9247-3a59cecbd5f5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:34.066810 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-20da1370-82c1-45c4-9247-3a59cecbd5f5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:34.067944 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-20da1370-82c1-45c4-9247-3a59cecbd5f5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:34.068766 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-20da1370-82c1-45c4-9247-3a59cecbd5f5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:34.069439 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-20da1370-82c1-45c4-9247-3a59cecbd5f5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:34.241542 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c83f493f-2277-4b15-a8f4-3787bc13da52 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:34.243032 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c83f493f-2277-4b15-a8f4-3787bc13da52 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:34.249757 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c83f493f-2277-4b15-a8f4-3787bc13da52 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:34.250520 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c83f493f-2277-4b15-a8f4-3787bc13da52 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:34.251347 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c83f493f-2277-4b15-a8f4-3787bc13da52 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:34.251854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c83f493f-2277-4b15-a8f4-3787bc13da52 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:34.537603 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-20da1370-82c1-45c4-9247-3a59cecbd5f5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:34.548541 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-20da1370-82c1-45c4-9247-3a59cecbd5f5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1370 microversion: 2.1 time: 0.520928 Jul 25 05:39:34.549549 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 128/257] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:34 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1370 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:34.554640 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7798ccee-f2d7-4c4f-9760-42d8eedb7795 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:34.555259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7798ccee-f2d7-4c4f-9760-42d8eedb7795 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:34.562061 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7798ccee-f2d7-4c4f-9760-42d8eedb7795 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:34.562513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7798ccee-f2d7-4c4f-9760-42d8eedb7795 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:34.563405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7798ccee-f2d7-4c4f-9760-42d8eedb7795 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:34.564296 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7798ccee-f2d7-4c4f-9760-42d8eedb7795 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:34.583424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:34.624957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-c83f493f-2277-4b15-a8f4-3787bc13da52 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:34.636905 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c83f493f-2277-4b15-a8f4-3787bc13da52 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1555 microversion: 2.1 time: 0.399874 Jul 25 05:39:34.638062 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 130/258] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:34 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1555 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:39:34.655570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-66fca6d9-ce2a-4408-beb0-872590433ad3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:34.656142 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-66fca6d9-ce2a-4408-beb0-872590433ad3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:34.668232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66fca6d9-ce2a-4408-beb0-872590433ad3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:34.668742 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66fca6d9-ce2a-4408-beb0-872590433ad3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:34.669958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66fca6d9-ce2a-4408-beb0-872590433ad3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:34.670689 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66fca6d9-ce2a-4408-beb0-872590433ad3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:34.867486 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-66fca6d9-ce2a-4408-beb0-872590433ad3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.216266 Jul 25 05:39:34.870386 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 131/259] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 25 05:39:34 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:34.890096 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7798ccee-f2d7-4c4f-9760-42d8eedb7795 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:34.912827 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7798ccee-f2d7-4c4f-9760-42d8eedb7795 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.361899 Jul 25 05:39:34.917571 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-364952a7-002f-483d-9133-cf435b873545 req-988a0481-9a44-4fae-bebd-a0d97366bd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa", "tag": "db49e6cc-810b-4a89-a2fb-e0718b506f4b"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:34.922540 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 129/260] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:34 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:34.924316 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:34.938491 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-364952a7-002f-483d-9133-cf435b873545 req-988a0481-9a44-4fae-bebd-a0d97366bd2b service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:34.939017 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-364952a7-002f-483d-9133-cf435b873545 req-988a0481-9a44-4fae-bebd-a0d97366bd2b service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:34.961661 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-364952a7-002f-483d-9133-cf435b873545 req-988a0481-9a44-4fae-bebd-a0d97366bd2b service nova] Creating event network-changed:db49e6cc-810b-4a89-a2fb-e0718b506f4b for instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa on hv-cinder-85083 Jul 25 05:39:34.969440 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-364952a7-002f-483d-9133-cf435b873545 req-988a0481-9a44-4fae-bebd-a0d97366bd2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055968 Jul 25 05:39:34.970287 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 132/261] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:35.565031 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4fd726c1-f8ff-4384-8618-363072bd12cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:35.565646 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4fd726c1-f8ff-4384-8618-363072bd12cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:35.572585 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4fd726c1-f8ff-4384-8618-363072bd12cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:35.573081 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4fd726c1-f8ff-4384-8618-363072bd12cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:35.573853 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4fd726c1-f8ff-4384-8618-363072bd12cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:35.574292 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4fd726c1-f8ff-4384-8618-363072bd12cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:35.727313 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4fd726c1-f8ff-4384-8618-363072bd12cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:35.734948 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4fd726c1-f8ff-4384-8618-363072bd12cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1370 microversion: 2.1 time: 0.173788 Jul 25 05:39:35.735526 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 130/262] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:35 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:35.911501 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=4 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:35.912478 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=20 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:35.917058 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-c9a9f602-2042-42f8-9b04-16f6851ea876 req-779efc00-a364-48c5-93b8-ae1d4980d5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5529050b-f2cf-4a8d-a44a-aeeff80f9a44", "tag": "a17feb40-f712-434b-ab5d-3a419f924bb1"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:35.929477 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-76d638c4-1e2b-4265-a6d8-12609f7dde29 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:35.930089 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-76d638c4-1e2b-4265-a6d8-12609f7dde29 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:35.937084 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-c9a9f602-2042-42f8-9b04-16f6851ea876 req-779efc00-a364-48c5-93b8-ae1d4980d5d9 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:35.937541 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-c9a9f602-2042-42f8-9b04-16f6851ea876 req-779efc00-a364-48c5-93b8-ae1d4980d5d9 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:35.940045 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-76d638c4-1e2b-4265-a6d8-12609f7dde29 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:35.940501 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-76d638c4-1e2b-4265-a6d8-12609f7dde29 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:35.941827 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-76d638c4-1e2b-4265-a6d8-12609f7dde29 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:35.942427 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-76d638c4-1e2b-4265-a6d8-12609f7dde29 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:35.951872 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-c9a9f602-2042-42f8-9b04-16f6851ea876 req-779efc00-a364-48c5-93b8-ae1d4980d5d9 service nova] Creating event network-changed:a17feb40-f712-434b-ab5d-3a419f924bb1 for instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 on hv-cinder-85083 Jul 25 05:39:35.957774 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-c9a9f602-2042-42f8-9b04-16f6851ea876 req-779efc00-a364-48c5-93b8-ae1d4980d5d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046789 Jul 25 05:39:35.959982 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 133/263] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:36.099277 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-76d638c4-1e2b-4265-a6d8-12609f7dde29 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:36.108631 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-76d638c4-1e2b-4265-a6d8-12609f7dde29 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.182868 Jul 25 05:39:36.110219 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 131/264] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:35 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:39:36.757581 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1823ede5-8397-4fd3-82f2-7643590398f4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:36.758984 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1823ede5-8397-4fd3-82f2-7643590398f4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:36.783537 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1823ede5-8397-4fd3-82f2-7643590398f4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:36.784835 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1823ede5-8397-4fd3-82f2-7643590398f4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:36.786961 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1823ede5-8397-4fd3-82f2-7643590398f4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:36.787711 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1823ede5-8397-4fd3-82f2-7643590398f4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:37.126673 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-88b7eac9-5f4f-487f-a200-df2cc734919e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:37.127317 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-88b7eac9-5f4f-487f-a200-df2cc734919e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:37.145683 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88b7eac9-5f4f-487f-a200-df2cc734919e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:37.146710 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88b7eac9-5f4f-487f-a200-df2cc734919e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:37.150916 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88b7eac9-5f4f-487f-a200-df2cc734919e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:37.151829 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88b7eac9-5f4f-487f-a200-df2cc734919e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:37.179748 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1823ede5-8397-4fd3-82f2-7643590398f4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:37.190212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=100 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:37.196727 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1823ede5-8397-4fd3-82f2-7643590398f4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1370 microversion: 2.1 time: 0.448815 Jul 25 05:39:37.198933 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 134/265] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:36 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1370 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:37.599230 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-88b7eac9-5f4f-487f-a200-df2cc734919e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:37.629817 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-88b7eac9-5f4f-487f-a200-df2cc734919e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.502874 Jul 25 05:39:37.631699 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 132/266] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:37 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:39:38.216637 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4cc7c91d-b83e-4048-ad97-69b6aa1eb046 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:38.218105 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4cc7c91d-b83e-4048-ad97-69b6aa1eb046 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:38.235725 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cc7c91d-b83e-4048-ad97-69b6aa1eb046 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:38.237010 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cc7c91d-b83e-4048-ad97-69b6aa1eb046 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:38.240431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cc7c91d-b83e-4048-ad97-69b6aa1eb046 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:38.241257 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cc7c91d-b83e-4048-ad97-69b6aa1eb046 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:38.628202 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4cc7c91d-b83e-4048-ad97-69b6aa1eb046 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:38.639297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4cc7c91d-b83e-4048-ad97-69b6aa1eb046 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1370 microversion: 2.1 time: 0.426715 Jul 25 05:39:38.640603 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 135/267] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:38 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1370 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:38.666657 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3b84523a-f63c-4dcc-b198-e6cdb7ca76d0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:38.669504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3b84523a-f63c-4dcc-b198-e6cdb7ca76d0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:38.681446 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b84523a-f63c-4dcc-b198-e6cdb7ca76d0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:38.682320 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b84523a-f63c-4dcc-b198-e6cdb7ca76d0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:38.683652 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b84523a-f63c-4dcc-b198-e6cdb7ca76d0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:38.684263 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b84523a-f63c-4dcc-b198-e6cdb7ca76d0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:38.905808 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3b84523a-f63c-4dcc-b198-e6cdb7ca76d0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:38.916474 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3b84523a-f63c-4dcc-b198-e6cdb7ca76d0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.263310 Jul 25 05:39:38.928955 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 133/268] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:38 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:39.663436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-50e2c74a-694b-409e-a65a-75a692268dfc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:39.664142 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-50e2c74a-694b-409e-a65a-75a692268dfc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:39.674267 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50e2c74a-694b-409e-a65a-75a692268dfc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:39.675099 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50e2c74a-694b-409e-a65a-75a692268dfc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:39.676925 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50e2c74a-694b-409e-a65a-75a692268dfc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:39.677381 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50e2c74a-694b-409e-a65a-75a692268dfc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:39.824812 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-50e2c74a-694b-409e-a65a-75a692268dfc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:39.833226 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-50e2c74a-694b-409e-a65a-75a692268dfc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1370 microversion: 2.1 time: 0.174533 Jul 25 05:39:39.833805 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 136/269] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:39 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:39.938643 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-11bf63b6-ff44-42c9-b03f-7c72182e28b3 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:39.939360 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-11bf63b6-ff44-42c9-b03f-7c72182e28b3 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:39.943779 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:39.949308 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11bf63b6-ff44-42c9-b03f-7c72182e28b3 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:39.949835 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11bf63b6-ff44-42c9-b03f-7c72182e28b3 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:39.950614 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11bf63b6-ff44-42c9-b03f-7c72182e28b3 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:39.951058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11bf63b6-ff44-42c9-b03f-7c72182e28b3 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:40.094944 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-11bf63b6-ff44-42c9-b03f-7c72182e28b3 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:40.103776 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-11bf63b6-ff44-42c9-b03f-7c72182e28b3 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.173585 Jul 25 05:39:40.113723 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 134/270] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:39 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:40.850435 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3172e5b6-96e2-4cf9-a0ce-e9c67425d241 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:40.850980 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3172e5b6-96e2-4cf9-a0ce-e9c67425d241 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:40.857441 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3172e5b6-96e2-4cf9-a0ce-e9c67425d241 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:40.857893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3172e5b6-96e2-4cf9-a0ce-e9c67425d241 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:40.858657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3172e5b6-96e2-4cf9-a0ce-e9c67425d241 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:40.859095 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3172e5b6-96e2-4cf9-a0ce-e9c67425d241 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:40.993108 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3172e5b6-96e2-4cf9-a0ce-e9c67425d241 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:41.001122 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3172e5b6-96e2-4cf9-a0ce-e9c67425d241 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1370 microversion: 2.1 time: 0.155331 Jul 25 05:39:41.001686 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 137/271] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:40 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:41.121565 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a24c25f4-3988-4b14-8e7e-09b24ff3f2a7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:41.122216 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a24c25f4-3988-4b14-8e7e-09b24ff3f2a7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:41.129502 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a24c25f4-3988-4b14-8e7e-09b24ff3f2a7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:41.130036 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a24c25f4-3988-4b14-8e7e-09b24ff3f2a7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:41.130885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a24c25f4-3988-4b14-8e7e-09b24ff3f2a7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:41.131328 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a24c25f4-3988-4b14-8e7e-09b24ff3f2a7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:41.190136 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-37376a1e-cef8-4e61-a7da-b101223f40d2 req-27355cbf-8e55-4f66-adb3-64841569f2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa", "name": "network-vif-plugged", "status": "completed", "tag": "db49e6cc-810b-4a89-a2fb-e0718b506f4b"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:41.209858 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-37376a1e-cef8-4e61-a7da-b101223f40d2 req-27355cbf-8e55-4f66-adb3-64841569f2e2 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:41.210527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-37376a1e-cef8-4e61-a7da-b101223f40d2 req-27355cbf-8e55-4f66-adb3-64841569f2e2 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:41.225751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-37376a1e-cef8-4e61-a7da-b101223f40d2 req-27355cbf-8e55-4f66-adb3-64841569f2e2 service nova] Creating event network-vif-plugged:db49e6cc-810b-4a89-a2fb-e0718b506f4b for instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa on hv-cinder-85083 Jul 25 05:39:41.231330 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-37376a1e-cef8-4e61-a7da-b101223f40d2 req-27355cbf-8e55-4f66-adb3-64841569f2e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045290 Jul 25 05:39:41.232174 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 138/272] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:41.288563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a24c25f4-3988-4b14-8e7e-09b24ff3f2a7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:41.298490 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a24c25f4-3988-4b14-8e7e-09b24ff3f2a7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.180806 Jul 25 05:39:41.309030 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 135/273] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:41 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:41.657758 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1248754941", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:41.709587 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.network.neutron [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] validate_networks() for None {{(pid=124467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:39:41.991826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Flavor limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:39:41.992399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Image limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:39:41.992702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Flavor pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:39:41.993131 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Image pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:39:41.993571 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:39:42.002340 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:42.002784 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:42.003566 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:42.004165 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:42.020829 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8a4faeaf-365f-4c2a-8651-964bcf5a476b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:42.021576 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8a4faeaf-365f-4c2a-8651-964bcf5a476b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:42.022032 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Getting quotas for project 5d8e26c74f99499fb3890a0613364236. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:39:42.026425 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Getting quotas for user 08384d4a71da47f380bd748acd913e27 and project 5d8e26c74f99499fb3890a0613364236. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:39:42.028075 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a4faeaf-365f-4c2a-8651-964bcf5a476b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:42.028608 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a4faeaf-365f-4c2a-8651-964bcf5a476b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:42.029524 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a4faeaf-365f-4c2a-8651-964bcf5a476b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:42.030058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a4faeaf-365f-4c2a-8651-964bcf5a476b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:42.038094 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Going to run 1 instances... {{(pid=124467) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:39:42.040462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:39:42.045997 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:42.087120 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=16 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:42.087362 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-16dc26d2-7b11-44aa-8eac-f7ef212697cf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.434561 Jul 25 05:39:42.092905 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 139/274] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:39:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:39:42.098769 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-23e8d64d-94cb-4f8a-97d1-8df5db9386c5 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:42.099365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-23e8d64d-94cb-4f8a-97d1-8df5db9386c5 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:42.176155 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-23e8d64d-94cb-4f8a-97d1-8df5db9386c5 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:42.190901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-23e8d64d-94cb-4f8a-97d1-8df5db9386c5 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1215 microversion: 2.1 time: 0.096479 Jul 25 05:39:42.192582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 140/275] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:42 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:39:42.317575 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1df14f83-cce1-47b4-9e21-1cb1931cd166 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:42.318348 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1df14f83-cce1-47b4-9e21-1cb1931cd166 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:42.325932 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1df14f83-cce1-47b4-9e21-1cb1931cd166 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:42.326512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1df14f83-cce1-47b4-9e21-1cb1931cd166 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:42.327483 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1df14f83-cce1-47b4-9e21-1cb1931cd166 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:42.328054 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1df14f83-cce1-47b4-9e21-1cb1931cd166 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:42.453891 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8a4faeaf-365f-4c2a-8651-964bcf5a476b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:42.466622 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8a4faeaf-365f-4c2a-8651-964bcf5a476b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1370 microversion: 2.1 time: 0.450509 Jul 25 05:39:42.467317 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 136/276] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:42 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1370 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:42.548087 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1df14f83-cce1-47b4-9e21-1cb1931cd166 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:42.558150 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1df14f83-cce1-47b4-9e21-1cb1931cd166 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.245203 Jul 25 05:39:42.558730 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 141/277] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:42 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:39:43.209625 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c9323ca2-1a6a-435d-8200-12c335c741ec tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:43.210250 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c9323ca2-1a6a-435d-8200-12c335c741ec tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:43.217105 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9323ca2-1a6a-435d-8200-12c335c741ec tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:43.217555 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9323ca2-1a6a-435d-8200-12c335c741ec tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:43.218308 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9323ca2-1a6a-435d-8200-12c335c741ec tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:43.218742 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9323ca2-1a6a-435d-8200-12c335c741ec tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:43.263840 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-0b436022-48c6-4f3d-8bf0-64d43ea44d8d req-a794837b-d40d-48b4-a8a3-fe8a11274b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd0febc-671b-4a39-9dbf-d71d6eb11b32", "name": "network-vif-plugged", "status": "completed", "tag": "9d91bc86-6db7-4b09-b3c9-3958dd762034"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:43.273040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-0b436022-48c6-4f3d-8bf0-64d43ea44d8d req-a794837b-d40d-48b4-a8a3-fe8a11274b11 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:43.273487 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-0b436022-48c6-4f3d-8bf0-64d43ea44d8d req-a794837b-d40d-48b4-a8a3-fe8a11274b11 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:43.279632 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c9323ca2-1a6a-435d-8200-12c335c741ec tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:43.285448 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-0b436022-48c6-4f3d-8bf0-64d43ea44d8d req-a794837b-d40d-48b4-a8a3-fe8a11274b11 service nova] Creating event network-vif-plugged:9d91bc86-6db7-4b09-b3c9-3958dd762034 for instance edd0febc-671b-4a39-9dbf-d71d6eb11b32 on hv-cinder-85083 Jul 25 05:39:43.288332 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c9323ca2-1a6a-435d-8200-12c335c741ec tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1211 microversion: 2.1 time: 0.083573 Jul 25 05:39:43.289043 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 137/278] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:43 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:43.304674 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-0b436022-48c6-4f3d-8bf0-64d43ea44d8d req-a794837b-d40d-48b4-a8a3-fe8a11274b11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040694 Jul 25 05:39:43.304674 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 142/279] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:43.484717 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d4910219-15ee-4bb0-98c4-1bab59e34fe2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:43.485313 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d4910219-15ee-4bb0-98c4-1bab59e34fe2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:43.491697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4910219-15ee-4bb0-98c4-1bab59e34fe2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:43.492288 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4910219-15ee-4bb0-98c4-1bab59e34fe2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:43.493296 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4910219-15ee-4bb0-98c4-1bab59e34fe2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:43.493915 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4910219-15ee-4bb0-98c4-1bab59e34fe2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:43.576565 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-051f5e74-41d2-4f3a-90a3-d0b8072e5bc0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:43.577297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-051f5e74-41d2-4f3a-90a3-d0b8072e5bc0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:43.583669 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-051f5e74-41d2-4f3a-90a3-d0b8072e5bc0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:43.585479 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-051f5e74-41d2-4f3a-90a3-d0b8072e5bc0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:43.586517 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-051f5e74-41d2-4f3a-90a3-d0b8072e5bc0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:43.587210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-051f5e74-41d2-4f3a-90a3-d0b8072e5bc0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:43.646525 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d4910219-15ee-4bb0-98c4-1bab59e34fe2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:43.656749 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d4910219-15ee-4bb0-98c4-1bab59e34fe2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1565 microversion: 2.1 time: 0.176650 Jul 25 05:39:43.657354 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 138/280] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:43 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:43.674313 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2bfbfa9f-312e-4900-a418-d5d83502055d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:43.674815 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2bfbfa9f-312e-4900-a418-d5d83502055d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:43.681817 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2bfbfa9f-312e-4900-a418-d5d83502055d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:43.682380 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2bfbfa9f-312e-4900-a418-d5d83502055d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:43.683036 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2bfbfa9f-312e-4900-a418-d5d83502055d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:43.683485 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2bfbfa9f-312e-4900-a418-d5d83502055d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:43.762503 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-051f5e74-41d2-4f3a-90a3-d0b8072e5bc0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:43.770242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-051f5e74-41d2-4f3a-90a3-d0b8072e5bc0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.197817 Jul 25 05:39:43.770830 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 143/281] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:43 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:43.779650 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2bfbfa9f-312e-4900-a418-d5d83502055d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109187 Jul 25 05:39:43.780316 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 139/282] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 25 05:39:43 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:44.306532 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-bf91d895-50c1-4f0f-9c45-395bb6b929a2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:44.307285 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-bf91d895-50c1-4f0f-9c45-395bb6b929a2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:44.314157 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bf91d895-50c1-4f0f-9c45-395bb6b929a2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:44.314614 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bf91d895-50c1-4f0f-9c45-395bb6b929a2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:44.315893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bf91d895-50c1-4f0f-9c45-395bb6b929a2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:44.316550 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bf91d895-50c1-4f0f-9c45-395bb6b929a2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:44.383569 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-bf91d895-50c1-4f0f-9c45-395bb6b929a2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:44.390929 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-bf91d895-50c1-4f0f-9c45-395bb6b929a2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1273 microversion: 2.1 time: 0.088562 Jul 25 05:39:44.391455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 144/283] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:44 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:44.790471 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-698517c0-00d3-4fb9-8f8f-8d814db97e20 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:44.791711 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-698517c0-00d3-4fb9-8f8f-8d814db97e20 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:44.809303 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-698517c0-00d3-4fb9-8f8f-8d814db97e20 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:44.810378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-698517c0-00d3-4fb9-8f8f-8d814db97e20 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:44.811313 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-698517c0-00d3-4fb9-8f8f-8d814db97e20 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:44.811993 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-698517c0-00d3-4fb9-8f8f-8d814db97e20 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:44.951290 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-6e5df3fd-b2e5-42d0-b5ad-221145aa3963 req-dc89ddea-a2a0-4a2c-b462-f2eb53a6b06c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa", "tag": "db49e6cc-810b-4a89-a2fb-e0718b506f4b"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:44.965798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-6e5df3fd-b2e5-42d0-b5ad-221145aa3963 req-dc89ddea-a2a0-4a2c-b462-f2eb53a6b06c service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:44.966254 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-6e5df3fd-b2e5-42d0-b5ad-221145aa3963 req-dc89ddea-a2a0-4a2c-b462-f2eb53a6b06c service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:44.980214 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-6e5df3fd-b2e5-42d0-b5ad-221145aa3963 req-dc89ddea-a2a0-4a2c-b462-f2eb53a6b06c service nova] Creating event network-changed:db49e6cc-810b-4a89-a2fb-e0718b506f4b for instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa on hv-cinder-85083 Jul 25 05:39:44.988639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-6e5df3fd-b2e5-42d0-b5ad-221145aa3963 req-dc89ddea-a2a0-4a2c-b462-f2eb53a6b06c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045136 Jul 25 05:39:44.989726 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 145/284] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:45.007976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-698517c0-00d3-4fb9-8f8f-8d814db97e20 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:45.016468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-698517c0-00d3-4fb9-8f8f-8d814db97e20 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.232436 Jul 25 05:39:45.017748 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 140/285] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:44 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:45.411727 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-bd28362a-c615-443d-9186-6c41c8310465 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:45.413120 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-bd28362a-c615-443d-9186-6c41c8310465 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:45.425919 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bd28362a-c615-443d-9186-6c41c8310465 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:45.428458 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bd28362a-c615-443d-9186-6c41c8310465 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:45.429982 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bd28362a-c615-443d-9186-6c41c8310465 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:45.430785 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bd28362a-c615-443d-9186-6c41c8310465 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:45.592530 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-bd28362a-c615-443d-9186-6c41c8310465 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:45.601891 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-bd28362a-c615-443d-9186-6c41c8310465 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1315 microversion: 2.1 time: 0.196006 Jul 25 05:39:45.602740 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 146/286] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:45 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:45.993415 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-565cfef9-1735-4a28-919d-5601f1dbd5d6 req-ec0068cb-aecd-4f6c-8501-8205ca0bbe72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf290dc-5227-420c-9fb4-319446471d45", "tag": "47b28122-7b78-431e-9225-a7c8db3ed804"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:46.005352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-565cfef9-1735-4a28-919d-5601f1dbd5d6 req-ec0068cb-aecd-4f6c-8501-8205ca0bbe72 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:46.006034 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-565cfef9-1735-4a28-919d-5601f1dbd5d6 req-ec0068cb-aecd-4f6c-8501-8205ca0bbe72 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:46.018774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-565cfef9-1735-4a28-919d-5601f1dbd5d6 req-ec0068cb-aecd-4f6c-8501-8205ca0bbe72 service nova] Creating event network-changed:47b28122-7b78-431e-9225-a7c8db3ed804 for instance bdf290dc-5227-420c-9fb4-319446471d45 on hv-cinder-85083 Jul 25 05:39:46.024505 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-565cfef9-1735-4a28-919d-5601f1dbd5d6 req-ec0068cb-aecd-4f6c-8501-8205ca0bbe72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035806 Jul 25 05:39:46.025460 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 141/287] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:46.034554 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f18c078f-6021-4863-9849-3820f570f648 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:46.035173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f18c078f-6021-4863-9849-3820f570f648 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:46.042042 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f18c078f-6021-4863-9849-3820f570f648 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:46.042794 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f18c078f-6021-4863-9849-3820f570f648 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:46.043872 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f18c078f-6021-4863-9849-3820f570f648 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:46.045043 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f18c078f-6021-4863-9849-3820f570f648 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:46.273447 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f18c078f-6021-4863-9849-3820f570f648 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:46.292864 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f18c078f-6021-4863-9849-3820f570f648 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1318 microversion: 2.1 time: 0.262074 Jul 25 05:39:46.294336 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 147/288] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:46 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:46.619543 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-58dc25b5-8ac8-49f6-87b8-0c69a1f262b7 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:46.620421 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-58dc25b5-8ac8-49f6-87b8-0c69a1f262b7 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:46.627075 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-58dc25b5-8ac8-49f6-87b8-0c69a1f262b7 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:46.627470 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-58dc25b5-8ac8-49f6-87b8-0c69a1f262b7 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:46.628311 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-58dc25b5-8ac8-49f6-87b8-0c69a1f262b7 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:46.628757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-58dc25b5-8ac8-49f6-87b8-0c69a1f262b7 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:46.867382 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-58dc25b5-8ac8-49f6-87b8-0c69a1f262b7 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:46.875793 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-58dc25b5-8ac8-49f6-87b8-0c69a1f262b7 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1315 microversion: 2.1 time: 0.260350 Jul 25 05:39:46.876859 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 142/289] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:46 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:47.310139 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-abed539f-e0a6-42d6-bf06-525d345589db tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:47.310789 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-abed539f-e0a6-42d6-bf06-525d345589db tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:47.317238 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-abed539f-e0a6-42d6-bf06-525d345589db tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:47.317683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-abed539f-e0a6-42d6-bf06-525d345589db tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:47.318432 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-abed539f-e0a6-42d6-bf06-525d345589db tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:47.319028 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-abed539f-e0a6-42d6-bf06-525d345589db tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:47.448320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-abed539f-e0a6-42d6-bf06-525d345589db tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:47.455841 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-abed539f-e0a6-42d6-bf06-525d345589db tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1508 microversion: 2.1 time: 0.149484 Jul 25 05:39:47.456400 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 148/290] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:47 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:47.893778 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-93291c50-f264-491e-9056-d3044041fa2f tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:47.894490 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-93291c50-f264-491e-9056-d3044041fa2f tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:47.902172 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93291c50-f264-491e-9056-d3044041fa2f tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:47.902635 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93291c50-f264-491e-9056-d3044041fa2f tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:47.903409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93291c50-f264-491e-9056-d3044041fa2f tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:47.903853 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93291c50-f264-491e-9056-d3044041fa2f tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:48.039682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-93291c50-f264-491e-9056-d3044041fa2f tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:48.047351 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-93291c50-f264-491e-9056-d3044041fa2f tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1315 microversion: 2.1 time: 0.157825 Jul 25 05:39:48.047917 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 143/291] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:47 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:49.064162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-15b0c921-0834-4bcd-8902-09c04a70e6f9 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:49.065097 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-15b0c921-0834-4bcd-8902-09c04a70e6f9 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:49.071720 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-15b0c921-0834-4bcd-8902-09c04a70e6f9 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:49.072331 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-15b0c921-0834-4bcd-8902-09c04a70e6f9 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:49.073119 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-15b0c921-0834-4bcd-8902-09c04a70e6f9 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:49.073557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-15b0c921-0834-4bcd-8902-09c04a70e6f9 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:49.210672 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-15b0c921-0834-4bcd-8902-09c04a70e6f9 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:49.218559 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-15b0c921-0834-4bcd-8902-09c04a70e6f9 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1315 microversion: 2.1 time: 0.158275 Jul 25 05:39:49.219238 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 149/292] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:49 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:50.237337 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c4534f95-6b99-4ab0-9038-81ceea708707 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:50.237950 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c4534f95-6b99-4ab0-9038-81ceea708707 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:50.245700 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4534f95-6b99-4ab0-9038-81ceea708707 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:50.246160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4534f95-6b99-4ab0-9038-81ceea708707 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:50.246987 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4534f95-6b99-4ab0-9038-81ceea708707 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:50.247381 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4534f95-6b99-4ab0-9038-81ceea708707 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:50.382798 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c4534f95-6b99-4ab0-9038-81ceea708707 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:50.390027 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c4534f95-6b99-4ab0-9038-81ceea708707 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1315 microversion: 2.1 time: 0.156692 Jul 25 05:39:50.390587 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 144/293] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:50 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:51.186798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-3f899b2c-b391-44e6-b906-f04c3a586fb1 req-10d6c5d7-96a2-40b5-ad33-648d712cc7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf290dc-5227-420c-9fb4-319446471d45", "name": "network-vif-plugged", "status": "completed", "tag": "47b28122-7b78-431e-9225-a7c8db3ed804"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:51.196448 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-3f899b2c-b391-44e6-b906-f04c3a586fb1 req-10d6c5d7-96a2-40b5-ad33-648d712cc7b5 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:51.197126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-3f899b2c-b391-44e6-b906-f04c3a586fb1 req-10d6c5d7-96a2-40b5-ad33-648d712cc7b5 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:51.211867 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-3f899b2c-b391-44e6-b906-f04c3a586fb1 req-10d6c5d7-96a2-40b5-ad33-648d712cc7b5 service nova] Creating event network-vif-plugged:47b28122-7b78-431e-9225-a7c8db3ed804 for instance bdf290dc-5227-420c-9fb4-319446471d45 on hv-cinder-85083 Jul 25 05:39:51.216830 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-3f899b2c-b391-44e6-b906-f04c3a586fb1 req-10d6c5d7-96a2-40b5-ad33-648d712cc7b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033682 Jul 25 05:39:51.217426 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 150/294] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:51.408364 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-97ba8ae1-5768-4594-9ef9-745821e68e48 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:51.409024 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-97ba8ae1-5768-4594-9ef9-745821e68e48 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:51.417247 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97ba8ae1-5768-4594-9ef9-745821e68e48 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:51.417942 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97ba8ae1-5768-4594-9ef9-745821e68e48 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:51.419105 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97ba8ae1-5768-4594-9ef9-745821e68e48 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:51.419554 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97ba8ae1-5768-4594-9ef9-745821e68e48 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:51.582768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1916637776", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1985723475", "security_groups": [{"name": "tempest-secgroup-smoke-1677006254"}], "block_device_mapping_v2": [{"uuid": "d1831bcf-2454-46cb-a3f9-517659bc4f20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0bd65f0e-472c-4905-913d-3224424e7dac"}]}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:51.589193 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-97ba8ae1-5768-4594-9ef9-745821e68e48 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:51.596799 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-97ba8ae1-5768-4594-9ef9-745821e68e48 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1315 microversion: 2.1 time: 0.193513 Jul 25 05:39:51.597369 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 145/295] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:51 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:51.700526 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.network.neutron [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] validate_networks() for [('0bd65f0e-472c-4905-913d-3224424e7dac', None, None, None, None, None)] {{(pid=124467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:39:52.011756 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=2 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:52.085762 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Flavor limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:39:52.086184 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Image limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:39:52.086660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Flavor pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:39:52.087072 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Image pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:39:52.087490 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:39:52.096399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:52.096885 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:52.097689 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:52.098132 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:52.115016 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Getting quotas for project ee638472255a48d2bdffa17a4ff22339. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:39:52.119145 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Getting quotas for user 1f815f111bf74739969736acea131927 and project ee638472255a48d2bdffa17a4ff22339. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:39:52.176127 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Going to run 1 instances... {{(pid=124467) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:39:52.178562 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1831bcf-2454-46cb-a3f9-517659bc4f20',volume_size=None,volume_type=None)] {{(pid=124467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:39:52.301989 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d19bca46-a6ed-4571-97e9-6c2a27fd3bfc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723426 Jul 25 05:39:52.302930 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 151/296] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:39:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 05:39:52.312639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f4b7efce-6408-4495-bdce-2cabc13961ae tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:52.313285 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f4b7efce-6408-4495-bdce-2cabc13961ae tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:52.377916 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f4b7efce-6408-4495-bdce-2cabc13961ae tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:52.386753 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f4b7efce-6408-4495-bdce-2cabc13961ae tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1095 microversion: 2.1 time: 0.077723 Jul 25 05:39:52.387533 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 146/297] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:52 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:52.613743 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3949a6db-cd03-4846-adf6-2ab75204fc05 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:52.614361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3949a6db-cd03-4846-adf6-2ab75204fc05 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:52.621397 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3949a6db-cd03-4846-adf6-2ab75204fc05 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:52.621844 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3949a6db-cd03-4846-adf6-2ab75204fc05 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:52.622610 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3949a6db-cd03-4846-adf6-2ab75204fc05 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:52.623047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3949a6db-cd03-4846-adf6-2ab75204fc05 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:52.765615 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3949a6db-cd03-4846-adf6-2ab75204fc05 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:52.773020 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3949a6db-cd03-4846-adf6-2ab75204fc05 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1315 microversion: 2.1 time: 0.163118 Jul 25 05:39:52.773610 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 152/298] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:52 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:52.957391 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9d0dad11-3949-4d01-9cfa-9423056c7dee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:52.957908 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9d0dad11-3949-4d01-9cfa-9423056c7dee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:52.965032 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d0dad11-3949-4d01-9cfa-9423056c7dee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:52.965492 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d0dad11-3949-4d01-9cfa-9423056c7dee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:52.966266 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d0dad11-3949-4d01-9cfa-9423056c7dee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:52.966713 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d0dad11-3949-4d01-9cfa-9423056c7dee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:52.990785 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9d0dad11-3949-4d01-9cfa-9423056c7dee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/ips" status: 200 len: 146 microversion: 2.1 time: 0.037415 Jul 25 05:39:52.991355 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 147/299] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 25 05:39:52 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:53.403903 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6c1ade68-72ed-410f-b823-35e5bfa4f835 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:53.404543 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6c1ade68-72ed-410f-b823-35e5bfa4f835 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:53.411057 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6c1ade68-72ed-410f-b823-35e5bfa4f835 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:53.411509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6c1ade68-72ed-410f-b823-35e5bfa4f835 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:53.412263 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6c1ade68-72ed-410f-b823-35e5bfa4f835 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:53.413349 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6c1ade68-72ed-410f-b823-35e5bfa4f835 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:53.477776 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6c1ade68-72ed-410f-b823-35e5bfa4f835 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:53.485196 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6c1ade68-72ed-410f-b823-35e5bfa4f835 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1193 microversion: 2.1 time: 0.085097 Jul 25 05:39:53.485752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 153/300] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:53 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:53.789651 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3bfa362a-c6ec-4ea4-acb6-502898c75cdf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:53.790230 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3bfa362a-c6ec-4ea4-acb6-502898c75cdf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:53.796401 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3bfa362a-c6ec-4ea4-acb6-502898c75cdf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:53.796875 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3bfa362a-c6ec-4ea4-acb6-502898c75cdf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:53.797639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3bfa362a-c6ec-4ea4-acb6-502898c75cdf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:53.798111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3bfa362a-c6ec-4ea4-acb6-502898c75cdf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:53.930356 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3bfa362a-c6ec-4ea4-acb6-502898c75cdf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:53.937831 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3bfa362a-c6ec-4ea4-acb6-502898c75cdf tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1465 microversion: 2.1 time: 0.152679 Jul 25 05:39:53.938387 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 148/301] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:53 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:53.977737 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-26e41bf9-0eb4-4da6-becc-54c15169b5e2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:53.978268 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-26e41bf9-0eb4-4da6-becc-54c15169b5e2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:53.984290 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26e41bf9-0eb4-4da6-becc-54c15169b5e2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:53.984744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26e41bf9-0eb4-4da6-becc-54c15169b5e2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:53.985531 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26e41bf9-0eb4-4da6-becc-54c15169b5e2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:53.985969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26e41bf9-0eb4-4da6-becc-54c15169b5e2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:54.013423 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-26e41bf9-0eb4-4da6-becc-54c15169b5e2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Going to try to terminate instance {{(pid=124467) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:39:54.072358 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:54.102317 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-26e41bf9-0eb4-4da6-becc-54c15169b5e2 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 204 len: 0 microversion: 2.1 time: 0.128098 Jul 25 05:39:54.102888 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 154/302] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:39:53 2022] DELETE /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:39:54.111090 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d40f4249-e178-42b9-b81c-8cd8542a5ebb tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:54.111700 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d40f4249-e178-42b9-b81c-8cd8542a5ebb tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:54.118441 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d40f4249-e178-42b9-b81c-8cd8542a5ebb tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:54.118889 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d40f4249-e178-42b9-b81c-8cd8542a5ebb tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:54.119643 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d40f4249-e178-42b9-b81c-8cd8542a5ebb tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:54.120079 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d40f4249-e178-42b9-b81c-8cd8542a5ebb tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:54.252230 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d40f4249-e178-42b9-b81c-8cd8542a5ebb tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:54.260478 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d40f4249-e178-42b9-b81c-8cd8542a5ebb tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1471 microversion: 2.1 time: 0.153280 Jul 25 05:39:54.261071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 149/303] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:54 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:54.502844 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1820e7ba-e36f-4d7c-97d3-d7f41a61535b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:54.503585 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1820e7ba-e36f-4d7c-97d3-d7f41a61535b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:54.510866 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1820e7ba-e36f-4d7c-97d3-d7f41a61535b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:54.511326 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1820e7ba-e36f-4d7c-97d3-d7f41a61535b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:54.512090 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1820e7ba-e36f-4d7c-97d3-d7f41a61535b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:54.512534 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1820e7ba-e36f-4d7c-97d3-d7f41a61535b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:54.579837 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1820e7ba-e36f-4d7c-97d3-d7f41a61535b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:54.587574 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1820e7ba-e36f-4d7c-97d3-d7f41a61535b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1201 microversion: 2.1 time: 0.088953 Jul 25 05:39:54.588133 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 155/304] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:54 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:55.278163 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e8db05f3-d51d-401e-8061-fb795a39933e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:55.278788 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e8db05f3-d51d-401e-8061-fb795a39933e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:55.285291 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8db05f3-d51d-401e-8061-fb795a39933e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:55.285743 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8db05f3-d51d-401e-8061-fb795a39933e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:55.286500 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8db05f3-d51d-401e-8061-fb795a39933e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:55.286940 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8db05f3-d51d-401e-8061-fb795a39933e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:55.420923 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e8db05f3-d51d-401e-8061-fb795a39933e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:55.429288 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e8db05f3-d51d-401e-8061-fb795a39933e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1471 microversion: 2.1 time: 0.154062 Jul 25 05:39:55.429789 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 150/305] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:55 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:55.604013 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9448d6c6-4cf4-4fbb-a8d2-9c209203cdba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:55.604654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-9448d6c6-4cf4-4fbb-a8d2-9c209203cdba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:55.611396 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9448d6c6-4cf4-4fbb-a8d2-9c209203cdba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:55.611844 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9448d6c6-4cf4-4fbb-a8d2-9c209203cdba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:55.612599 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9448d6c6-4cf4-4fbb-a8d2-9c209203cdba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:55.613071 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9448d6c6-4cf4-4fbb-a8d2-9c209203cdba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:55.682227 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9448d6c6-4cf4-4fbb-a8d2-9c209203cdba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:55.689643 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-9448d6c6-4cf4-4fbb-a8d2-9c209203cdba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1201 microversion: 2.1 time: 0.090194 Jul 25 05:39:55.690199 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 156/306] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:55 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:56.446276 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-264c50c9-2503-4138-9b86-cf5ce74cc55e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:56.447046 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-264c50c9-2503-4138-9b86-cf5ce74cc55e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:56.461411 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-264c50c9-2503-4138-9b86-cf5ce74cc55e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:56.462117 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-264c50c9-2503-4138-9b86-cf5ce74cc55e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:56.463397 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-264c50c9-2503-4138-9b86-cf5ce74cc55e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:56.465751 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-264c50c9-2503-4138-9b86-cf5ce74cc55e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:56.693474 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-264c50c9-2503-4138-9b86-cf5ce74cc55e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08384d4a71da47f380bd748acd913e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e26c74f99499fb3890a0613364236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:56.702927 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-264c50c9-2503-4138-9b86-cf5ce74cc55e tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 200 len: 1471 microversion: 2.1 time: 0.260545 Jul 25 05:39:56.703840 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 151/307] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:56 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:56.707139 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7090931c-edd2-4f5d-b4b6-1627d1694365 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:56.708249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7090931c-edd2-4f5d-b4b6-1627d1694365 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:56.715995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7090931c-edd2-4f5d-b4b6-1627d1694365 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:56.716671 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7090931c-edd2-4f5d-b4b6-1627d1694365 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:56.717643 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7090931c-edd2-4f5d-b4b6-1627d1694365 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:56.718296 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7090931c-edd2-4f5d-b4b6-1627d1694365 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:56.793171 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7090931c-edd2-4f5d-b4b6-1627d1694365 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:56.801705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7090931c-edd2-4f5d-b4b6-1627d1694365 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1211 microversion: 2.1 time: 0.098267 Jul 25 05:39:56.802358 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 157/308] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:56 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:57.010600 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-e7128c47-4e7e-483e-8776-c93a342bf014 req-78c6e63f-4cb3-4234-a48e-ec0a178d119e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf290dc-5227-420c-9fb4-319446471d45", "name": "network-vif-deleted", "tag": "47b28122-7b78-431e-9225-a7c8db3ed804"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:57.023501 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-e7128c47-4e7e-483e-8776-c93a342bf014 req-78c6e63f-4cb3-4234-a48e-ec0a178d119e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:57.024370 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-e7128c47-4e7e-483e-8776-c93a342bf014 req-78c6e63f-4cb3-4234-a48e-ec0a178d119e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:57.049836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-e7128c47-4e7e-483e-8776-c93a342bf014 req-78c6e63f-4cb3-4234-a48e-ec0a178d119e service nova] Creating event network-vif-deleted:47b28122-7b78-431e-9225-a7c8db3ed804 for instance bdf290dc-5227-420c-9fb4-319446471d45 on hv-cinder-85083 Jul 25 05:39:57.056062 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-e7128c47-4e7e-483e-8776-c93a342bf014 req-78c6e63f-4cb3-4234-a48e-ec0a178d119e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055763 Jul 25 05:39:57.056767 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 152/309] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:57.555390 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-034bfea2-ed6b-4c06-925b-bacead5ed832 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75d3e840-7ab9-4fc3-8f9c-7974aaf63d51"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:57.556539 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-034bfea2-ed6b-4c06-925b-bacead5ed832 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:57.563020 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-034bfea2-ed6b-4c06-925b-bacead5ed832 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:57.563497 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-034bfea2-ed6b-4c06-925b-bacead5ed832 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:57.564275 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-034bfea2-ed6b-4c06-925b-bacead5ed832 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:57.564707 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-034bfea2-ed6b-4c06-925b-bacead5ed832 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:57.746505 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-be391af2-b9b6-4e86-811d-ed8444d548c1 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:57.748045 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-be391af2-b9b6-4e86-811d-ed8444d548c1 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] [instance: bdf290dc-5227-420c-9fb4-319446471d45] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:57.767530 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-be391af2-b9b6-4e86-811d-ed8444d548c1 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:57.768626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-be391af2-b9b6-4e86-811d-ed8444d548c1 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:57.770598 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-be391af2-b9b6-4e86-811d-ed8444d548c1 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:57.771249 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-be391af2-b9b6-4e86-811d-ed8444d548c1 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:57.825466 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-be391af2-b9b6-4e86-811d-ed8444d548c1 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] HTTP exception thrown: Instance bdf290dc-5227-420c-9fb4-319446471d45 could not be found. Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-be391af2-b9b6-4e86-811d-ed8444d548c1 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Request method failure captured: Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 HTTP/1.1 Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iyc3WD0hH_t7m9jtO7v9EyECgou0FmZtN-OLpWPn9SYQD3FMRvSI8GgxNIMbq30758IlGfIGI_AnqCY1LYHF8CmOgNmloAApMAr7XootOoXqBU-Bnldnd99FIWOURgwOIRT9Tf391SHJjgkXApP5f2_hCbKoMs1eTusVY-_SoZHoiM Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 5d8e26c74f99499fb3890a0613364236 Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesNegativeTest-468178965 Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:39:57.827265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d8e26c74f99499fb3890a0613364236"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d8e26c74f99499fb3890a0613364236"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d8e26c74f99499fb3890a0613364236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d8e26c74f99499fb3890a0613364236"}]}] Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesNegativeTest-468178965 Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 5d8e26c74f99499fb3890a0613364236 Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesNegativeTest-468178965 Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesNegativeTest-468178965-project Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 08384d4a71da47f380bd748acd913e27 Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesNegativeTest-468178965-project Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance bdf290dc-5227-420c-9fb4-319446471d45 could not be found. Jul 25 05:39:57.829071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': 'bdf290dc-5227-420c-9fb4-319446471d45'} Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf290dc-5227-420c-9fb4-319446471d45 could not be found. Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:39:57.830093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf290dc-5227-420c-9fb4-319446471d45 could not be found. Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf290dc-5227-420c-9fb4-319446471d45 could not be found. Jul 25 05:39:57.832158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:39:57.834107 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-be391af2-b9b6-4e86-811d-ed8444d548c1 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] Returning 404 to user: Instance bdf290dc-5227-420c-9fb4-319446471d45 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:39:57.834107 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-be391af2-b9b6-4e86-811d-ed8444d548c1 tempest-VolumesNegativeTest-468178965 tempest-VolumesNegativeTest-468178965-project] 10.222.0.33 "GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45" status: 404 len: 111 microversion: 2.1 time: 0.112985 Jul 25 05:39:57.834107 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 153/310] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:57 2022] GET /compute/v2.1/servers/bdf290dc-5227-420c-9fb4-319446471d45 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:39:57.845217 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-992eb38d-94c6-428b-957f-f0bcbb2e81cc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:57.845947 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-992eb38d-94c6-428b-957f-f0bcbb2e81cc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:57.854758 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-992eb38d-94c6-428b-957f-f0bcbb2e81cc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:57.855225 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-992eb38d-94c6-428b-957f-f0bcbb2e81cc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:57.856198 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-992eb38d-94c6-428b-957f-f0bcbb2e81cc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:57.856653 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-992eb38d-94c6-428b-957f-f0bcbb2e81cc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:58.127132 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-992eb38d-94c6-428b-957f-f0bcbb2e81cc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:58.138672 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-992eb38d-94c6-428b-957f-f0bcbb2e81cc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1279 microversion: 2.1 time: 0.302743 Jul 25 05:39:58.153037 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 154/311] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:57 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1279 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:39:58.161216 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-4fc704d8-0197-4afe-8c3f-139ddc2f7a44 req-a6e0b219-4185-4f3b-bbd0-bb595351e4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6fa910c-7604-4aa9-82ff-477d62f57f54", "tag": "e15bc07d-1abd-455e-907e-fa844fbf01ce"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:39:58.170708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-4fc704d8-0197-4afe-8c3f-139ddc2f7a44 req-a6e0b219-4185-4f3b-bbd0-bb595351e4d2 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:58.171176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-4fc704d8-0197-4afe-8c3f-139ddc2f7a44 req-a6e0b219-4185-4f3b-bbd0-bb595351e4d2 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:58.187669 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-4fc704d8-0197-4afe-8c3f-139ddc2f7a44 req-a6e0b219-4185-4f3b-bbd0-bb595351e4d2 service nova] Creating event network-changed:e15bc07d-1abd-455e-907e-fa844fbf01ce for instance f6fa910c-7604-4aa9-82ff-477d62f57f54 on hv-cinder-85083 Jul 25 05:39:58.193402 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-4fc704d8-0197-4afe-8c3f-139ddc2f7a44 req-a6e0b219-4185-4f3b-bbd0-bb595351e4d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039003 Jul 25 05:39:58.194222 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-034bfea2-ed6b-4c06-925b-bacead5ed832 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "POST /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637952 Jul 25 05:39:58.195826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 158/312] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:39:57 2022] POST /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:39:58.200371 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 155/313] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:39:59.158561 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-aebffee5-ff72-4f5f-89e2-acb9295cc0e3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:39:59.159279 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-aebffee5-ff72-4f5f-89e2-acb9295cc0e3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:39:59.167905 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aebffee5-ff72-4f5f-89e2-acb9295cc0e3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:59.168600 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aebffee5-ff72-4f5f-89e2-acb9295cc0e3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:59.173667 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aebffee5-ff72-4f5f-89e2-acb9295cc0e3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:39:59.174210 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aebffee5-ff72-4f5f-89e2-acb9295cc0e3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:39:59.329586 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aebffee5-ff72-4f5f-89e2-acb9295cc0e3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:39:59.338542 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-aebffee5-ff72-4f5f-89e2-acb9295cc0e3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.185774 Jul 25 05:39:59.339114 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 156/314] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:39:59 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:00.357997 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-0767c571-2a72-474e-88b8-aba8e14d3db3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:00.358880 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-0767c571-2a72-474e-88b8-aba8e14d3db3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:00.366403 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0767c571-2a72-474e-88b8-aba8e14d3db3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:00.366932 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0767c571-2a72-474e-88b8-aba8e14d3db3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:00.367868 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0767c571-2a72-474e-88b8-aba8e14d3db3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:00.368456 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0767c571-2a72-474e-88b8-aba8e14d3db3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:00.521795 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-0767c571-2a72-474e-88b8-aba8e14d3db3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:00.530064 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-0767c571-2a72-474e-88b8-aba8e14d3db3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.177189 Jul 25 05:40:00.530751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 159/315] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:00 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:01.548797 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b121d653-091f-4df8-ac63-3cbe8f3fa879 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:01.549478 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b121d653-091f-4df8-ac63-3cbe8f3fa879 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:01.556314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b121d653-091f-4df8-ac63-3cbe8f3fa879 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:01.556767 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b121d653-091f-4df8-ac63-3cbe8f3fa879 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:01.557575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b121d653-091f-4df8-ac63-3cbe8f3fa879 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:01.558049 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b121d653-091f-4df8-ac63-3cbe8f3fa879 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:01.578037 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:01.713628 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b121d653-091f-4df8-ac63-3cbe8f3fa879 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:01.722295 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b121d653-091f-4df8-ac63-3cbe8f3fa879 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.178140 Jul 25 05:40:01.722927 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 157/316] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:01 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:02.739148 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-80218b4d-f9a7-4bbe-bbfb-4bd677a8e655 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:02.739888 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-80218b4d-f9a7-4bbe-bbfb-4bd677a8e655 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:02.742445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=2 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:02.743160 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=14 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:02.748982 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80218b4d-f9a7-4bbe-bbfb-4bd677a8e655 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:02.749440 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80218b4d-f9a7-4bbe-bbfb-4bd677a8e655 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:02.750209 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80218b4d-f9a7-4bbe-bbfb-4bd677a8e655 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:02.750654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80218b4d-f9a7-4bbe-bbfb-4bd677a8e655 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:02.889464 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-80218b4d-f9a7-4bbe-bbfb-4bd677a8e655 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:02.897303 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-80218b4d-f9a7-4bbe-bbfb-4bd677a8e655 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.162162 Jul 25 05:40:02.898421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 160/317] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:02 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:03.914555 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8cfe152e-9dd0-4e9b-a8d0-e4f0827f87f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:03.915696 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8cfe152e-9dd0-4e9b-a8d0-e4f0827f87f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:03.917589 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:03.923457 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8cfe152e-9dd0-4e9b-a8d0-e4f0827f87f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:03.923952 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8cfe152e-9dd0-4e9b-a8d0-e4f0827f87f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:03.924727 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8cfe152e-9dd0-4e9b-a8d0-e4f0827f87f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:03.925207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8cfe152e-9dd0-4e9b-a8d0-e4f0827f87f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:04.056708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8cfe152e-9dd0-4e9b-a8d0-e4f0827f87f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:04.064294 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8cfe152e-9dd0-4e9b-a8d0-e4f0827f87f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.153843 Jul 25 05:40:04.064885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 158/318] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:03 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:05.081478 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4d868ed7-7ea3-4b00-a73b-2d7c6c7e7704 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:05.082084 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4d868ed7-7ea3-4b00-a73b-2d7c6c7e7704 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:05.084422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:05.092139 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d868ed7-7ea3-4b00-a73b-2d7c6c7e7704 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:05.092585 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d868ed7-7ea3-4b00-a73b-2d7c6c7e7704 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:05.093372 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d868ed7-7ea3-4b00-a73b-2d7c6c7e7704 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:05.093810 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d868ed7-7ea3-4b00-a73b-2d7c6c7e7704 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:05.227765 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4d868ed7-7ea3-4b00-a73b-2d7c6c7e7704 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:05.235109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4d868ed7-7ea3-4b00-a73b-2d7c6c7e7704 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.157421 Jul 25 05:40:05.235659 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 161/319] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:05 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:06.252215 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d138e783-a530-4f0a-b346-f128ce1b07cb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:06.252870 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d138e783-a530-4f0a-b346-f128ce1b07cb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:06.260115 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d138e783-a530-4f0a-b346-f128ce1b07cb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:06.260578 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d138e783-a530-4f0a-b346-f128ce1b07cb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:06.261383 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d138e783-a530-4f0a-b346-f128ce1b07cb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:06.261831 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d138e783-a530-4f0a-b346-f128ce1b07cb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:06.391132 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d138e783-a530-4f0a-b346-f128ce1b07cb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:06.399352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d138e783-a530-4f0a-b346-f128ce1b07cb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.150958 Jul 25 05:40:06.399915 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 159/320] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:06 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:07.415621 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-14556f34-fca7-47d8-899a-36bd21d70e74 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:07.416229 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-14556f34-fca7-47d8-899a-36bd21d70e74 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:07.422682 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14556f34-fca7-47d8-899a-36bd21d70e74 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:07.423128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14556f34-fca7-47d8-899a-36bd21d70e74 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:07.423912 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14556f34-fca7-47d8-899a-36bd21d70e74 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:07.424349 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14556f34-fca7-47d8-899a-36bd21d70e74 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:07.556426 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-14556f34-fca7-47d8-899a-36bd21d70e74 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:07.563863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-14556f34-fca7-47d8-899a-36bd21d70e74 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.152310 Jul 25 05:40:07.564431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 162/321] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:07 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:08.581108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-50129f60-b8b1-4726-8a99-fa4a56a3b551 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:08.581714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-50129f60-b8b1-4726-8a99-fa4a56a3b551 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:08.589449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50129f60-b8b1-4726-8a99-fa4a56a3b551 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:08.589917 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50129f60-b8b1-4726-8a99-fa4a56a3b551 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:08.590745 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50129f60-b8b1-4726-8a99-fa4a56a3b551 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:08.591238 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50129f60-b8b1-4726-8a99-fa4a56a3b551 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:08.720250 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-50129f60-b8b1-4726-8a99-fa4a56a3b551 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:08.727725 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-50129f60-b8b1-4726-8a99-fa4a56a3b551 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.150538 Jul 25 05:40:08.728282 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 160/322] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:08 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:09.744011 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-324eb810-e030-4128-b384-4310d9568c1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:09.744625 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-324eb810-e030-4128-b384-4310d9568c1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:09.751167 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-324eb810-e030-4128-b384-4310d9568c1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:09.751625 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-324eb810-e030-4128-b384-4310d9568c1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:09.752390 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-324eb810-e030-4128-b384-4310d9568c1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:09.752861 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-324eb810-e030-4128-b384-4310d9568c1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:09.892773 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-324eb810-e030-4128-b384-4310d9568c1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:09.900767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-324eb810-e030-4128-b384-4310d9568c1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.160679 Jul 25 05:40:09.901375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 163/323] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:09 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:10.917926 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-27285f29-4218-412d-8b72-4ccc5bbc422a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:10.918575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-27285f29-4218-412d-8b72-4ccc5bbc422a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:10.921010 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=56 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:10.926233 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27285f29-4218-412d-8b72-4ccc5bbc422a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:10.926598 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27285f29-4218-412d-8b72-4ccc5bbc422a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:10.927409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27285f29-4218-412d-8b72-4ccc5bbc422a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:10.927852 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27285f29-4218-412d-8b72-4ccc5bbc422a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:11.057770 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-27285f29-4218-412d-8b72-4ccc5bbc422a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:11.065173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-27285f29-4218-412d-8b72-4ccc5bbc422a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.151755 Jul 25 05:40:11.065732 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 161/324] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:10 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:12.081607 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e82e1096-ca90-498d-97e4-a704a7ba3939 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:12.082226 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e82e1096-ca90-498d-97e4-a704a7ba3939 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:12.089065 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e82e1096-ca90-498d-97e4-a704a7ba3939 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:12.089524 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e82e1096-ca90-498d-97e4-a704a7ba3939 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:12.090286 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e82e1096-ca90-498d-97e4-a704a7ba3939 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:12.090730 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e82e1096-ca90-498d-97e4-a704a7ba3939 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:12.218782 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e82e1096-ca90-498d-97e4-a704a7ba3939 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:12.227070 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e82e1096-ca90-498d-97e4-a704a7ba3939 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.148406 Jul 25 05:40:12.227651 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 164/325] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:12 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:13.243559 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-52391956-413a-44bc-a9d5-966ae92f5e2c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:13.244424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-52391956-413a-44bc-a9d5-966ae92f5e2c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:13.250991 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52391956-413a-44bc-a9d5-966ae92f5e2c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:13.251453 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52391956-413a-44bc-a9d5-966ae92f5e2c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:13.252220 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52391956-413a-44bc-a9d5-966ae92f5e2c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:13.252694 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52391956-413a-44bc-a9d5-966ae92f5e2c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:13.384871 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-52391956-413a-44bc-a9d5-966ae92f5e2c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:13.392145 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-52391956-413a-44bc-a9d5-966ae92f5e2c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.152605 Jul 25 05:40:13.392704 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 162/326] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:13 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:14.408709 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-69304cbc-b51d-481b-9003-14879bea6abb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:14.409283 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-69304cbc-b51d-481b-9003-14879bea6abb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:14.416444 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-69304cbc-b51d-481b-9003-14879bea6abb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:14.416928 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-69304cbc-b51d-481b-9003-14879bea6abb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:14.417688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-69304cbc-b51d-481b-9003-14879bea6abb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:14.418124 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-69304cbc-b51d-481b-9003-14879bea6abb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:14.546847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-69304cbc-b51d-481b-9003-14879bea6abb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:14.554294 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-69304cbc-b51d-481b-9003-14879bea6abb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.149386 Jul 25 05:40:14.554891 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 165/327] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:14 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:15.570698 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-49b5e280-0e7c-4d19-a341-ed218698110b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:15.571317 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-49b5e280-0e7c-4d19-a341-ed218698110b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:15.577855 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49b5e280-0e7c-4d19-a341-ed218698110b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:15.578312 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49b5e280-0e7c-4d19-a341-ed218698110b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:15.579069 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49b5e280-0e7c-4d19-a341-ed218698110b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:15.579512 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49b5e280-0e7c-4d19-a341-ed218698110b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:15.713225 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-49b5e280-0e7c-4d19-a341-ed218698110b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:15.720634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-49b5e280-0e7c-4d19-a341-ed218698110b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.154041 Jul 25 05:40:15.721229 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 163/328] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:15 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:16.737267 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cf7ea904-cf38-4ca4-b4a5-610b724a18a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:16.737830 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-cf7ea904-cf38-4ca4-b4a5-610b724a18a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:16.745051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cf7ea904-cf38-4ca4-b4a5-610b724a18a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:16.745501 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cf7ea904-cf38-4ca4-b4a5-610b724a18a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:16.746257 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cf7ea904-cf38-4ca4-b4a5-610b724a18a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:16.746696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cf7ea904-cf38-4ca4-b4a5-610b724a18a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:16.880271 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cf7ea904-cf38-4ca4-b4a5-610b724a18a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:16.888239 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cf7ea904-cf38-4ca4-b4a5-610b724a18a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.154910 Jul 25 05:40:16.888820 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 166/329] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:16 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:17.905283 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f4809960-e7f2-4dc8-913a-3486a3316361 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:17.905896 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f4809960-e7f2-4dc8-913a-3486a3316361 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:17.912420 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f4809960-e7f2-4dc8-913a-3486a3316361 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:17.912901 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f4809960-e7f2-4dc8-913a-3486a3316361 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:17.913659 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f4809960-e7f2-4dc8-913a-3486a3316361 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:17.914097 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f4809960-e7f2-4dc8-913a-3486a3316361 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:18.046756 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f4809960-e7f2-4dc8-913a-3486a3316361 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:18.054172 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f4809960-e7f2-4dc8-913a-3486a3316361 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.152697 Jul 25 05:40:18.054733 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 164/330] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:17 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:19.071020 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3925c9eb-0eef-4b20-9a1c-c41492b6d043 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:19.071554 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3925c9eb-0eef-4b20-9a1c-c41492b6d043 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:19.077958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3925c9eb-0eef-4b20-9a1c-c41492b6d043 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:19.078409 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3925c9eb-0eef-4b20-9a1c-c41492b6d043 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:19.079157 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3925c9eb-0eef-4b20-9a1c-c41492b6d043 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:19.079591 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3925c9eb-0eef-4b20-9a1c-c41492b6d043 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:19.209704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3925c9eb-0eef-4b20-9a1c-c41492b6d043 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:19.217305 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3925c9eb-0eef-4b20-9a1c-c41492b6d043 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.150241 Jul 25 05:40:19.217868 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 167/331] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:19 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:20.233959 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7e86bc3c-fb66-4fd0-aa0a-43ce9263dcb9 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:20.234492 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7e86bc3c-fb66-4fd0-aa0a-43ce9263dcb9 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:20.240938 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e86bc3c-fb66-4fd0-aa0a-43ce9263dcb9 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:20.241392 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e86bc3c-fb66-4fd0-aa0a-43ce9263dcb9 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:20.242152 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e86bc3c-fb66-4fd0-aa0a-43ce9263dcb9 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:20.242697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e86bc3c-fb66-4fd0-aa0a-43ce9263dcb9 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:20.374044 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7e86bc3c-fb66-4fd0-aa0a-43ce9263dcb9 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:20.381267 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7e86bc3c-fb66-4fd0-aa0a-43ce9263dcb9 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.151218 Jul 25 05:40:20.381830 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 165/332] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:20 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:21.398622 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-26e7176a-1e25-4ca4-be84-09cbc3aa1d12 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:21.399793 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-26e7176a-1e25-4ca4-be84-09cbc3aa1d12 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:21.406322 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26e7176a-1e25-4ca4-be84-09cbc3aa1d12 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:21.406774 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26e7176a-1e25-4ca4-be84-09cbc3aa1d12 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:21.407538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26e7176a-1e25-4ca4-be84-09cbc3aa1d12 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:21.407977 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26e7176a-1e25-4ca4-be84-09cbc3aa1d12 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:21.594061 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-00526907-b045-4a9a-b954-c9539e4351f3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:40:21.601957 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00526907-b045-4a9a-b954-c9539e4351f3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:21.603352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00526907-b045-4a9a-b954-c9539e4351f3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:21.628522 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-26e7176a-1e25-4ca4-be84-09cbc3aa1d12 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:21.640987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-26e7176a-1e25-4ca4-be84-09cbc3aa1d12 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.246096 Jul 25 05:40:21.642090 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 168/333] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:21 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:21.676217 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-00526907-b045-4a9a-b954-c9539e4351f3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Going to try to stop instance {{(pid=124466) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 05:40:21.687581 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-4267cbcc-1351-44b0-b89a-5ca7f2bbfa0a req-0010d73e-c5ab-4d01-9bd9-fb97840e18f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fa910c-7604-4aa9-82ff-477d62f57f54", "name": "network-vif-plugged", "status": "completed", "tag": "e15bc07d-1abd-455e-907e-fa844fbf01ce"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:40:21.700732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-4267cbcc-1351-44b0-b89a-5ca7f2bbfa0a req-0010d73e-c5ab-4d01-9bd9-fb97840e18f2 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:21.701320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-4267cbcc-1351-44b0-b89a-5ca7f2bbfa0a req-0010d73e-c5ab-4d01-9bd9-fb97840e18f2 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:21.715996 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-4267cbcc-1351-44b0-b89a-5ca7f2bbfa0a req-0010d73e-c5ab-4d01-9bd9-fb97840e18f2 service nova] Creating event network-vif-plugged:e15bc07d-1abd-455e-907e-fa844fbf01ce for instance f6fa910c-7604-4aa9-82ff-477d62f57f54 on hv-cinder-85083 Jul 25 05:40:21.723485 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-4267cbcc-1351-44b0-b89a-5ca7f2bbfa0a req-0010d73e-c5ab-4d01-9bd9-fb97840e18f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041614 Jul 25 05:40:21.724646 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 169/334] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:40:21.727226 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-00526907-b045-4a9a-b954-c9539e4351f3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "POST /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/action" status: 202 len: 0 microversion: 2.1 time: 0.137182 Jul 25 05:40:21.728062 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 166/335] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:40:21 2022] POST /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 05:40:21.737805 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-66ab83de-f88c-48a2-b43f-eb34ad1df9e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:21.738515 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-66ab83de-f88c-48a2-b43f-eb34ad1df9e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:21.745698 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66ab83de-f88c-48a2-b43f-eb34ad1df9e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:21.746152 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66ab83de-f88c-48a2-b43f-eb34ad1df9e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:21.746920 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66ab83de-f88c-48a2-b43f-eb34ad1df9e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:21.747364 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66ab83de-f88c-48a2-b43f-eb34ad1df9e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:21.892052 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-66ab83de-f88c-48a2-b43f-eb34ad1df9e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:21.894863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:21.904911 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-66ab83de-f88c-48a2-b43f-eb34ad1df9e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.171530 Jul 25 05:40:21.905491 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 170/336] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:21 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:22.630414 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fe9068c2-1ece-47da-a905-76edb8c7ec43 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "727ea29c-538c-441a-a59c-968b24c12f94", "device": "/dev/sdb"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:40:22.632094 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fe9068c2-1ece-47da-a905-76edb8c7ec43 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:22.639840 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe9068c2-1ece-47da-a905-76edb8c7ec43 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:22.640402 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe9068c2-1ece-47da-a905-76edb8c7ec43 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:22.641461 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe9068c2-1ece-47da-a905-76edb8c7ec43 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:22.642018 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe9068c2-1ece-47da-a905-76edb8c7ec43 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:22.659539 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-54de3cbc-f58e-44b3-9a84-e83b72837697 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:22.660161 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-54de3cbc-f58e-44b3-9a84-e83b72837697 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:22.668978 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-54de3cbc-f58e-44b3-9a84-e83b72837697 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:22.669443 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-54de3cbc-f58e-44b3-9a84-e83b72837697 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:22.670260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-54de3cbc-f58e-44b3-9a84-e83b72837697 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:22.670847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-54de3cbc-f58e-44b3-9a84-e83b72837697 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:22.834514 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-54de3cbc-f58e-44b3-9a84-e83b72837697 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:22.842759 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-54de3cbc-f58e-44b3-9a84-e83b72837697 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.188200 Jul 25 05:40:22.843321 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 171/337] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:22 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:22.922090 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-272d6685-bb88-4996-83dd-91910d74ab58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:22.922736 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-272d6685-bb88-4996-83dd-91910d74ab58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:22.928648 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-272d6685-bb88-4996-83dd-91910d74ab58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:22.929135 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-272d6685-bb88-4996-83dd-91910d74ab58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:22.929896 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-272d6685-bb88-4996-83dd-91910d74ab58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:22.930341 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-272d6685-bb88-4996-83dd-91910d74ab58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:23.060398 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-272d6685-bb88-4996-83dd-91910d74ab58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:23.068289 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-272d6685-bb88-4996-83dd-91910d74ab58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.149944 Jul 25 05:40:23.068869 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 172/338] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:22 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:23.859486 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ed3225eb-4e18-414b-9d14-c32aec089a48 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:23.860077 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ed3225eb-4e18-414b-9d14-c32aec089a48 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:23.866609 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ed3225eb-4e18-414b-9d14-c32aec089a48 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:23.867058 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ed3225eb-4e18-414b-9d14-c32aec089a48 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:23.867809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ed3225eb-4e18-414b-9d14-c32aec089a48 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:23.868629 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ed3225eb-4e18-414b-9d14-c32aec089a48 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:24.001156 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ed3225eb-4e18-414b-9d14-c32aec089a48 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:24.009534 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ed3225eb-4e18-414b-9d14-c32aec089a48 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1267 microversion: 2.1 time: 0.153065 Jul 25 05:40:24.010333 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 173/339] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:23 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:24.086558 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-885c6038-1e6e-4007-9996-ffe8d1b13ac0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:24.087795 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-885c6038-1e6e-4007-9996-ffe8d1b13ac0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:24.094094 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-885c6038-1e6e-4007-9996-ffe8d1b13ac0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:24.094628 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-885c6038-1e6e-4007-9996-ffe8d1b13ac0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:24.095494 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-885c6038-1e6e-4007-9996-ffe8d1b13ac0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:24.096118 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-885c6038-1e6e-4007-9996-ffe8d1b13ac0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:24.173669 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fe9068c2-1ece-47da-a905-76edb8c7ec43 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "POST /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.547382 Jul 25 05:40:24.174352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 167/340] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:40:22 2022] POST /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32/os-volume_attachments => generated 194 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:40:24.245825 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-885c6038-1e6e-4007-9996-ffe8d1b13ac0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:24.254331 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-885c6038-1e6e-4007-9996-ffe8d1b13ac0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.171855 Jul 25 05:40:24.254887 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 174/341] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:24 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:25.028925 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7b487ca2-bc31-4d25-9f5a-fa38efa8cb33 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:25.029546 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7b487ca2-bc31-4d25-9f5a-fa38efa8cb33 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:25.035807 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b487ca2-bc31-4d25-9f5a-fa38efa8cb33 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:25.036266 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b487ca2-bc31-4d25-9f5a-fa38efa8cb33 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:25.037063 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b487ca2-bc31-4d25-9f5a-fa38efa8cb33 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:25.037508 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b487ca2-bc31-4d25-9f5a-fa38efa8cb33 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:25.174959 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7b487ca2-bc31-4d25-9f5a-fa38efa8cb33 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:25.183805 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7b487ca2-bc31-4d25-9f5a-fa38efa8cb33 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1455 microversion: 2.1 time: 0.161193 Jul 25 05:40:25.184369 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 168/342] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:25 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:25.201249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-983dc34b-cd3b-444b-aafc-e5c6aa5b2c97 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:25.201910 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-983dc34b-cd3b-444b-aafc-e5c6aa5b2c97 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:25.208333 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-983dc34b-cd3b-444b-aafc-e5c6aa5b2c97 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:25.208831 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-983dc34b-cd3b-444b-aafc-e5c6aa5b2c97 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:25.209566 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-983dc34b-cd3b-444b-aafc-e5c6aa5b2c97 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:25.209999 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-983dc34b-cd3b-444b-aafc-e5c6aa5b2c97 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:25.273241 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3ff65b7e-b35f-48df-a1dc-5f68fc5d69ae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:25.273849 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3ff65b7e-b35f-48df-a1dc-5f68fc5d69ae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:25.282064 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ff65b7e-b35f-48df-a1dc-5f68fc5d69ae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:25.282736 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ff65b7e-b35f-48df-a1dc-5f68fc5d69ae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:25.283526 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ff65b7e-b35f-48df-a1dc-5f68fc5d69ae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:25.283969 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ff65b7e-b35f-48df-a1dc-5f68fc5d69ae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:25.376607 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-983dc34b-cd3b-444b-aafc-e5c6aa5b2c97 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:25.384892 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-983dc34b-cd3b-444b-aafc-e5c6aa5b2c97 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1455 microversion: 2.1 time: 0.187458 Jul 25 05:40:25.385461 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 175/343] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:25 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:25.438017 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3ff65b7e-b35f-48df-a1dc-5f68fc5d69ae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:25.447149 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3ff65b7e-b35f-48df-a1dc-5f68fc5d69ae tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.177307 Jul 25 05:40:25.447746 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 169/344] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:25 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:26.465797 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c6e28e00-ab90-4edb-a376-156c3a6e621f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:26.466692 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c6e28e00-ab90-4edb-a376-156c3a6e621f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:26.473725 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c6e28e00-ab90-4edb-a376-156c3a6e621f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:26.474215 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c6e28e00-ab90-4edb-a376-156c3a6e621f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:26.474993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c6e28e00-ab90-4edb-a376-156c3a6e621f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:26.475474 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c6e28e00-ab90-4edb-a376-156c3a6e621f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:26.613474 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-c6e28e00-ab90-4edb-a376-156c3a6e621f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:26.622356 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c6e28e00-ab90-4edb-a376-156c3a6e621f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.161718 Jul 25 05:40:26.623143 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 176/345] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:26 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:27.398096 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-47c23f4b-da66-4cb5-9874-f8fb85ae935c req-dc4e7417-4111-4374-8137-7f2906ffecc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6fa910c-7604-4aa9-82ff-477d62f57f54", "tag": "e15bc07d-1abd-455e-907e-fa844fbf01ce"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:40:27.407762 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-47c23f4b-da66-4cb5-9874-f8fb85ae935c req-dc4e7417-4111-4374-8137-7f2906ffecc7 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:27.408325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-47c23f4b-da66-4cb5-9874-f8fb85ae935c req-dc4e7417-4111-4374-8137-7f2906ffecc7 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:27.421470 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-47c23f4b-da66-4cb5-9874-f8fb85ae935c req-dc4e7417-4111-4374-8137-7f2906ffecc7 service nova] Creating event network-changed:e15bc07d-1abd-455e-907e-fa844fbf01ce for instance f6fa910c-7604-4aa9-82ff-477d62f57f54 on hv-cinder-85083 Jul 25 05:40:27.427871 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-47c23f4b-da66-4cb5-9874-f8fb85ae935c req-dc4e7417-4111-4374-8137-7f2906ffecc7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033445 Jul 25 05:40:27.429172 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 170/346] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:40:27.642652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ca13e05c-eaf6-4617-ba09-9395762b4f31 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:27.643269 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ca13e05c-eaf6-4617-ba09-9395762b4f31 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:27.650405 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ca13e05c-eaf6-4617-ba09-9395762b4f31 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:27.651073 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ca13e05c-eaf6-4617-ba09-9395762b4f31 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:27.651881 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ca13e05c-eaf6-4617-ba09-9395762b4f31 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:27.652568 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ca13e05c-eaf6-4617-ba09-9395762b4f31 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:27.913458 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ca13e05c-eaf6-4617-ba09-9395762b4f31 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:27.922018 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ca13e05c-eaf6-4617-ba09-9395762b4f31 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.283199 Jul 25 05:40:27.927987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 177/347] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:27 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:28.939628 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ec5c3bdd-caca-4134-b387-dc09c197d356 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:28.940261 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ec5c3bdd-caca-4134-b387-dc09c197d356 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:28.946456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec5c3bdd-caca-4134-b387-dc09c197d356 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:28.947447 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec5c3bdd-caca-4134-b387-dc09c197d356 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:28.948212 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec5c3bdd-caca-4134-b387-dc09c197d356 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:28.948660 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec5c3bdd-caca-4134-b387-dc09c197d356 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:29.082996 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ec5c3bdd-caca-4134-b387-dc09c197d356 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:29.091795 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ec5c3bdd-caca-4134-b387-dc09c197d356 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.156998 Jul 25 05:40:29.092368 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 171/348] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:28 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:30.108382 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-50804771-058c-4ba0-a593-03851e3e719b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:30.109037 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-50804771-058c-4ba0-a593-03851e3e719b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:30.115475 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50804771-058c-4ba0-a593-03851e3e719b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:30.115920 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50804771-058c-4ba0-a593-03851e3e719b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:30.116667 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50804771-058c-4ba0-a593-03851e3e719b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:30.117139 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50804771-058c-4ba0-a593-03851e3e719b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:30.251435 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-50804771-058c-4ba0-a593-03851e3e719b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:30.259554 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-50804771-058c-4ba0-a593-03851e3e719b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.154838 Jul 25 05:40:30.260115 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 178/349] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:30 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:31.277537 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8efd7ac8-702e-4a67-a37c-9f4115234515 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:31.278056 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8efd7ac8-702e-4a67-a37c-9f4115234515 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:31.284457 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8efd7ac8-702e-4a67-a37c-9f4115234515 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:31.284943 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8efd7ac8-702e-4a67-a37c-9f4115234515 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:31.285703 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8efd7ac8-702e-4a67-a37c-9f4115234515 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:31.286143 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8efd7ac8-702e-4a67-a37c-9f4115234515 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:31.301181 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:31.418016 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8efd7ac8-702e-4a67-a37c-9f4115234515 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:31.425945 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8efd7ac8-702e-4a67-a37c-9f4115234515 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.153455 Jul 25 05:40:31.426499 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 172/350] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:31 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:32.443160 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-526b962f-0468-4106-bb5e-451297746423 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:32.443772 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-526b962f-0468-4106-bb5e-451297746423 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:32.450652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-526b962f-0468-4106-bb5e-451297746423 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:32.451105 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-526b962f-0468-4106-bb5e-451297746423 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:32.451867 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-526b962f-0468-4106-bb5e-451297746423 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:32.452316 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-526b962f-0468-4106-bb5e-451297746423 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:32.580452 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-526b962f-0468-4106-bb5e-451297746423 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:32.589115 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-526b962f-0468-4106-bb5e-451297746423 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.149839 Jul 25 05:40:32.589683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 179/351] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:32 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:33.606793 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-97b3079c-16ce-41f1-a7fa-8fc50d55444a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:33.607399 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-97b3079c-16ce-41f1-a7fa-8fc50d55444a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:33.613803 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97b3079c-16ce-41f1-a7fa-8fc50d55444a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:33.614254 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97b3079c-16ce-41f1-a7fa-8fc50d55444a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:33.615033 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97b3079c-16ce-41f1-a7fa-8fc50d55444a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:33.615468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97b3079c-16ce-41f1-a7fa-8fc50d55444a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:33.747066 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-97b3079c-16ce-41f1-a7fa-8fc50d55444a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:33.754849 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-97b3079c-16ce-41f1-a7fa-8fc50d55444a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.152490 Jul 25 05:40:33.755412 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 173/352] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:33 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:34.771542 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ece7997c-4a83-47dd-ac43-f664cd3dc910 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:34.772067 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ece7997c-4a83-47dd-ac43-f664cd3dc910 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:34.779296 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ece7997c-4a83-47dd-ac43-f664cd3dc910 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:34.779750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ece7997c-4a83-47dd-ac43-f664cd3dc910 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:34.780506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ece7997c-4a83-47dd-ac43-f664cd3dc910 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:34.780973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ece7997c-4a83-47dd-ac43-f664cd3dc910 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:34.910564 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ece7997c-4a83-47dd-ac43-f664cd3dc910 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:34.919557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ece7997c-4a83-47dd-ac43-f664cd3dc910 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.151940 Jul 25 05:40:34.920131 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 180/353] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:34 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:35.937094 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-80cec888-743f-48de-8218-0f99ed9c936b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:35.937699 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-80cec888-743f-48de-8218-0f99ed9c936b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:35.944072 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-80cec888-743f-48de-8218-0f99ed9c936b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:35.944523 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-80cec888-743f-48de-8218-0f99ed9c936b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:35.945315 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-80cec888-743f-48de-8218-0f99ed9c936b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:35.945754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-80cec888-743f-48de-8218-0f99ed9c936b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:36.077032 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-80cec888-743f-48de-8218-0f99ed9c936b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:36.084798 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-80cec888-743f-48de-8218-0f99ed9c936b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.151621 Jul 25 05:40:36.085357 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 174/354] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:35 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:37.102298 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-50972d07-5fec-4760-b7fd-59d7e938d913 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:37.102988 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-50972d07-5fec-4760-b7fd-59d7e938d913 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:37.105535 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=40 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:37.111084 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50972d07-5fec-4760-b7fd-59d7e938d913 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:37.111542 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50972d07-5fec-4760-b7fd-59d7e938d913 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:37.112313 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50972d07-5fec-4760-b7fd-59d7e938d913 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:37.112758 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-50972d07-5fec-4760-b7fd-59d7e938d913 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:37.243130 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-50972d07-5fec-4760-b7fd-59d7e938d913 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:37.252274 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-50972d07-5fec-4760-b7fd-59d7e938d913 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.153909 Jul 25 05:40:37.252845 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 181/355] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:37 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:38.270393 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9e7b8800-79e2-4e4f-81c9-26864b7e7620 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:38.271008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9e7b8800-79e2-4e4f-81c9-26864b7e7620 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:38.277533 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9e7b8800-79e2-4e4f-81c9-26864b7e7620 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:38.277986 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9e7b8800-79e2-4e4f-81c9-26864b7e7620 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:38.278747 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9e7b8800-79e2-4e4f-81c9-26864b7e7620 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:38.279192 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9e7b8800-79e2-4e4f-81c9-26864b7e7620 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:38.413738 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9e7b8800-79e2-4e4f-81c9-26864b7e7620 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:38.422333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9e7b8800-79e2-4e4f-81c9-26864b7e7620 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.155835 Jul 25 05:40:38.423077 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 175/356] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:38 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:39.440415 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4eb8d776-b53f-4679-b40a-1519b2ecc6cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:39.441009 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4eb8d776-b53f-4679-b40a-1519b2ecc6cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:39.447911 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4eb8d776-b53f-4679-b40a-1519b2ecc6cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:39.448359 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4eb8d776-b53f-4679-b40a-1519b2ecc6cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:39.449154 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4eb8d776-b53f-4679-b40a-1519b2ecc6cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:39.449596 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4eb8d776-b53f-4679-b40a-1519b2ecc6cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:39.584040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4eb8d776-b53f-4679-b40a-1519b2ecc6cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:39.592560 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4eb8d776-b53f-4679-b40a-1519b2ecc6cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.156049 Jul 25 05:40:39.593382 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 182/357] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:39 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:40.610098 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0bcd3a36-7344-4a59-8044-7617ae5400c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:40.610630 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0bcd3a36-7344-4a59-8044-7617ae5400c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:40.617189 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bcd3a36-7344-4a59-8044-7617ae5400c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:40.617646 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bcd3a36-7344-4a59-8044-7617ae5400c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:40.618406 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bcd3a36-7344-4a59-8044-7617ae5400c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:40.619521 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bcd3a36-7344-4a59-8044-7617ae5400c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:40.749739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0bcd3a36-7344-4a59-8044-7617ae5400c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:40.757467 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0bcd3a36-7344-4a59-8044-7617ae5400c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.151284 Jul 25 05:40:40.758023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 176/358] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:40 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:41.775171 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6505adc8-e01e-42b3-b22d-8c2e23aef1c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:41.775873 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6505adc8-e01e-42b3-b22d-8c2e23aef1c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:41.782841 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6505adc8-e01e-42b3-b22d-8c2e23aef1c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:41.783294 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6505adc8-e01e-42b3-b22d-8c2e23aef1c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:41.784097 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6505adc8-e01e-42b3-b22d-8c2e23aef1c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:41.784537 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6505adc8-e01e-42b3-b22d-8c2e23aef1c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:41.919246 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6505adc8-e01e-42b3-b22d-8c2e23aef1c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:41.927043 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6505adc8-e01e-42b3-b22d-8c2e23aef1c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.156053 Jul 25 05:40:41.927619 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 183/359] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:41 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:42.594729 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-df7e84ec-f5de-41c3-aedb-afbf4350cef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27dbbdee-9852-4b6a-86a3-125e386a3519"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:40:42.595829 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-df7e84ec-f5de-41c3-aedb-afbf4350cef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:42.598166 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=32 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:42.604493 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df7e84ec-f5de-41c3-aedb-afbf4350cef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:42.604992 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df7e84ec-f5de-41c3-aedb-afbf4350cef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:42.605759 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df7e84ec-f5de-41c3-aedb-afbf4350cef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:42.606199 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df7e84ec-f5de-41c3-aedb-afbf4350cef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:42.907958 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-df7e84ec-f5de-41c3-aedb-afbf4350cef8 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "POST /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317010 Jul 25 05:40:42.908507 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 177/360] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:40:42 2022] POST /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:40:42.944887 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-13589c23-be6d-4b81-bfe9-2f4b242eb823 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:42.945534 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-13589c23-be6d-4b81-bfe9-2f4b242eb823 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:42.953398 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-13589c23-be6d-4b81-bfe9-2f4b242eb823 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:42.953845 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-13589c23-be6d-4b81-bfe9-2f4b242eb823 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:42.954661 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-13589c23-be6d-4b81-bfe9-2f4b242eb823 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:42.955220 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-13589c23-be6d-4b81-bfe9-2f4b242eb823 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:43.090251 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-13589c23-be6d-4b81-bfe9-2f4b242eb823 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:43.098376 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-13589c23-be6d-4b81-bfe9-2f4b242eb823 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.157351 Jul 25 05:40:43.099541 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 184/361] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:42 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:43.693996 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5b251496-1cb4-4476-af3d-68cc763e3ace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:43.694510 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5b251496-1cb4-4476-af3d-68cc763e3ace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:43.701325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b251496-1cb4-4476-af3d-68cc763e3ace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:43.701776 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b251496-1cb4-4476-af3d-68cc763e3ace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:43.702532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b251496-1cb4-4476-af3d-68cc763e3ace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:43.702968 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b251496-1cb4-4476-af3d-68cc763e3ace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:43.727545 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5b251496-1cb4-4476-af3d-68cc763e3ace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44/ips" status: 200 len: 149 microversion: 2.1 time: 0.038287 Jul 25 05:40:43.728135 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 178/362] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 25 05:40:43 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:40:43.738740 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-23f047da-4712-4df5-a1fb-a45396e575a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "408b6643-16f3-4433-b331-4698bb311caf"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:40:43.739863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-23f047da-4712-4df5-a1fb-a45396e575a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:43.745924 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-23f047da-4712-4df5-a1fb-a45396e575a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:43.746381 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-23f047da-4712-4df5-a1fb-a45396e575a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:43.747150 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-23f047da-4712-4df5-a1fb-a45396e575a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:43.747591 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-23f047da-4712-4df5-a1fb-a45396e575a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:43.829511 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-23f047da-4712-4df5-a1fb-a45396e575a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Invalid volume: volume 408b6643-16f3-4433-b331-4698bb311caf is already attached to instances: f5a28e80-5bf2-46af-9ece-8f7d147629fe Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-23f047da-4712-4df5-a1fb-a45396e575a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: POST /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44/os-volume_attachments HTTP/1.1 Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 74 Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:40:43.831253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {"volumeAttachment": {"volumeId": "408b6643-16f3-4433-b331-4698bb311caf"}} Jul 25 05:40:43.832895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Invalid volume: volume 408b6643-16f3-4433-b331-4698bb311caf is already attached to instances: f5a28e80-5bf2-46af-9ece-8f7d147629fe Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'server_id': '5529050b-f2cf-4a8d-a44a-aeeff80f9a44', 'body': {'volumeAttachment': {'volumeId': '408b6643-16f3-4433-b331-4698bb311caf'}}} Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 408b6643-16f3-4433-b331-4698bb311caf is already attached to instances: f5a28e80-5bf2-46af-9ece-8f7d147629fe Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:40:43.833878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 408b6643-16f3-4433-b331-4698bb311caf is already attached to instances: f5a28e80-5bf2-46af-9ece-8f7d147629fe Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:40:43.835417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:40:43.838100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:40:43.838100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:40:43.838100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:40:43.838100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 408b6643-16f3-4433-b331-4698bb311caf is already attached to instances: f5a28e80-5bf2-46af-9ece-8f7d147629fe Jul 25 05:40:43.838100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:40:43.838100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-23f047da-4712-4df5-a1fb-a45396e575a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 400 to user: Invalid volume: volume 408b6643-16f3-4433-b331-4698bb311caf is already attached to instances: f5a28e80-5bf2-46af-9ece-8f7d147629fe {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:40:43.838100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-23f047da-4712-4df5-a1fb-a45396e575a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097883 Jul 25 05:40:43.838100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 185/363] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:40:43 2022] POST /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 05:40:43.843401 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5c1881c8-1714-46fa-b7ef-ce27b14ee05d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:43.843901 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5c1881c8-1714-46fa-b7ef-ce27b14ee05d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:43.850611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c1881c8-1714-46fa-b7ef-ce27b14ee05d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:43.851133 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c1881c8-1714-46fa-b7ef-ce27b14ee05d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:43.851896 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c1881c8-1714-46fa-b7ef-ce27b14ee05d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:43.852338 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c1881c8-1714-46fa-b7ef-ce27b14ee05d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:43.877114 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5c1881c8-1714-46fa-b7ef-ce27b14ee05d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:40:43.949460 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5c1881c8-1714-46fa-b7ef-ce27b14ee05d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 204 len: 0 microversion: 2.1 time: 0.109678 Jul 25 05:40:43.950192 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 179/364] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:40:43 2022] DELETE /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:40:43.959711 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-412c3d30-dea4-4c14-a0cf-3407a3afd378 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:43.960339 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-412c3d30-dea4-4c14-a0cf-3407a3afd378 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:43.968524 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-412c3d30-dea4-4c14-a0cf-3407a3afd378 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:43.969106 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-412c3d30-dea4-4c14-a0cf-3407a3afd378 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:43.969883 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-412c3d30-dea4-4c14-a0cf-3407a3afd378 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:43.970330 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-412c3d30-dea4-4c14-a0cf-3407a3afd378 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:44.107589 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-412c3d30-dea4-4c14-a0cf-3407a3afd378 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:44.115403 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-412c3d30-dea4-4c14-a0cf-3407a3afd378 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1680 microversion: 2.1 time: 0.160863 Jul 25 05:40:44.115955 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 186/365] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:43 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:44.117393 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-69d077f9-8154-4dd1-adc3-378d18f3e35d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:44.118104 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-69d077f9-8154-4dd1-adc3-378d18f3e35d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:44.125735 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-69d077f9-8154-4dd1-adc3-378d18f3e35d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:44.126184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-69d077f9-8154-4dd1-adc3-378d18f3e35d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:44.126952 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-69d077f9-8154-4dd1-adc3-378d18f3e35d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:44.127392 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-69d077f9-8154-4dd1-adc3-378d18f3e35d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:44.256813 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-69d077f9-8154-4dd1-adc3-378d18f3e35d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:44.265500 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-69d077f9-8154-4dd1-adc3-378d18f3e35d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.152307 Jul 25 05:40:44.266060 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 180/366] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:44 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:45.133204 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-fac3bbf0-1217-4909-8197-2f0af89321b3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:45.133840 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-fac3bbf0-1217-4909-8197-2f0af89321b3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:45.140723 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fac3bbf0-1217-4909-8197-2f0af89321b3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:45.141212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fac3bbf0-1217-4909-8197-2f0af89321b3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:45.141966 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fac3bbf0-1217-4909-8197-2f0af89321b3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:45.142409 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fac3bbf0-1217-4909-8197-2f0af89321b3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:45.157672 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=100 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:45.278435 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-fac3bbf0-1217-4909-8197-2f0af89321b3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:45.282831 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-88466d29-8d3a-4b8a-9b34-928344be5c0e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:45.283483 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-88466d29-8d3a-4b8a-9b34-928344be5c0e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:45.285948 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-fac3bbf0-1217-4909-8197-2f0af89321b3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1680 microversion: 2.1 time: 0.156508 Jul 25 05:40:45.286521 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 187/367] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:45 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:45.290061 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88466d29-8d3a-4b8a-9b34-928344be5c0e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:45.290560 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88466d29-8d3a-4b8a-9b34-928344be5c0e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:45.291387 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88466d29-8d3a-4b8a-9b34-928344be5c0e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:45.291838 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88466d29-8d3a-4b8a-9b34-928344be5c0e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:45.420058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-88466d29-8d3a-4b8a-9b34-928344be5c0e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:45.427853 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-88466d29-8d3a-4b8a-9b34-928344be5c0e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.148864 Jul 25 05:40:45.428415 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 181/368] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:45 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:46.303472 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-92914894-eb27-4814-867f-f8ed6d4c640a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:46.304082 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-92914894-eb27-4814-867f-f8ed6d4c640a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:46.311208 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92914894-eb27-4814-867f-f8ed6d4c640a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:46.311661 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92914894-eb27-4814-867f-f8ed6d4c640a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:46.312427 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92914894-eb27-4814-867f-f8ed6d4c640a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:46.312894 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92914894-eb27-4814-867f-f8ed6d4c640a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:46.445140 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-92914894-eb27-4814-867f-f8ed6d4c640a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:46.446126 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-738c0344-afaa-49b1-bb31-8305f313a4f4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:46.446735 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-738c0344-afaa-49b1-bb31-8305f313a4f4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:46.452879 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-92914894-eb27-4814-867f-f8ed6d4c640a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1680 microversion: 2.1 time: 0.153175 Jul 25 05:40:46.453440 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-738c0344-afaa-49b1-bb31-8305f313a4f4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:46.453594 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 188/369] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:46 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:46.453889 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-738c0344-afaa-49b1-bb31-8305f313a4f4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:46.454683 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-738c0344-afaa-49b1-bb31-8305f313a4f4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:46.455207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-738c0344-afaa-49b1-bb31-8305f313a4f4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:46.582552 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-738c0344-afaa-49b1-bb31-8305f313a4f4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:46.591300 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-738c0344-afaa-49b1-bb31-8305f313a4f4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.149357 Jul 25 05:40:46.591868 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 182/370] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:46 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:47.470938 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e6e94049-e497-425b-9fc8-e4ecc0f4c106 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:47.471485 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e6e94049-e497-425b-9fc8-e4ecc0f4c106 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:47.477979 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e6e94049-e497-425b-9fc8-e4ecc0f4c106 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:47.479074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e6e94049-e497-425b-9fc8-e4ecc0f4c106 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:47.479818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e6e94049-e497-425b-9fc8-e4ecc0f4c106 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:47.480250 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e6e94049-e497-425b-9fc8-e4ecc0f4c106 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:47.604974 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e6e94049-e497-425b-9fc8-e4ecc0f4c106 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:47.608846 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8288489c-f890-43c8-9f55-bb99fc5faf58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:47.609455 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8288489c-f890-43c8-9f55-bb99fc5faf58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:47.612624 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e6e94049-e497-425b-9fc8-e4ecc0f4c106 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1680 microversion: 2.1 time: 0.145264 Jul 25 05:40:47.613211 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 189/371] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:47 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:47.616002 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8288489c-f890-43c8-9f55-bb99fc5faf58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:47.616466 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8288489c-f890-43c8-9f55-bb99fc5faf58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:47.617275 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8288489c-f890-43c8-9f55-bb99fc5faf58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:47.617720 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8288489c-f890-43c8-9f55-bb99fc5faf58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:47.754213 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8288489c-f890-43c8-9f55-bb99fc5faf58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:47.762929 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8288489c-f890-43c8-9f55-bb99fc5faf58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1724 microversion: 2.1 time: 0.157792 Jul 25 05:40:47.763514 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 183/372] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:47 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:48.631427 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c565cc2c-4f28-4203-98f8-0c332bafad9c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:48.632029 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c565cc2c-4f28-4203-98f8-0c332bafad9c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:48.638548 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c565cc2c-4f28-4203-98f8-0c332bafad9c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:48.638996 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c565cc2c-4f28-4203-98f8-0c332bafad9c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:48.639747 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c565cc2c-4f28-4203-98f8-0c332bafad9c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:48.640180 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c565cc2c-4f28-4203-98f8-0c332bafad9c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:48.771581 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-c565cc2c-4f28-4203-98f8-0c332bafad9c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:48.780848 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-66937d75-d572-4e5f-8227-25cd227d8c19 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:48.781468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-66937d75-d572-4e5f-8227-25cd227d8c19 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:48.787988 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66937d75-d572-4e5f-8227-25cd227d8c19 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:48.788414 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c565cc2c-4f28-4203-98f8-0c332bafad9c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1680 microversion: 2.1 time: 0.160775 Jul 25 05:40:48.788536 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66937d75-d572-4e5f-8227-25cd227d8c19 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:48.789018 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 190/373] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:48 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:48.789214 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66937d75-d572-4e5f-8227-25cd227d8c19 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:48.789653 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-66937d75-d572-4e5f-8227-25cd227d8c19 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:48.980464 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-66937d75-d572-4e5f-8227-25cd227d8c19 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:48.989412 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-66937d75-d572-4e5f-8227-25cd227d8c19 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1701 microversion: 2.1 time: 0.212236 Jul 25 05:40:48.989988 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 184/374] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:48 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1701 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:49.005787 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b0c7710a-02f3-4be9-ae58-f66e06709409 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:40:49.012702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b0c7710a-02f3-4be9-ae58-f66e06709409 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:49.013245 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b0c7710a-02f3-4be9-ae58-f66e06709409 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:49.077348 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b0c7710a-02f3-4be9-ae58-f66e06709409 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Going to try to start instance {{(pid=124467) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 05:40:49.129070 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b0c7710a-02f3-4be9-ae58-f66e06709409 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "POST /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/action" status: 202 len: 0 microversion: 2.1 time: 0.126790 Jul 25 05:40:49.129660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 191/375] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:40:49 2022] POST /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:40:49.140039 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c90fe924-d673-4b99-bf6b-52baf8aa9d58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:49.140742 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c90fe924-d673-4b99-bf6b-52baf8aa9d58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:49.150931 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c90fe924-d673-4b99-bf6b-52baf8aa9d58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:49.154734 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c90fe924-d673-4b99-bf6b-52baf8aa9d58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:49.155616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c90fe924-d673-4b99-bf6b-52baf8aa9d58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:49.156211 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c90fe924-d673-4b99-bf6b-52baf8aa9d58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:49.485463 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c90fe924-d673-4b99-bf6b-52baf8aa9d58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:49.493615 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c90fe924-d673-4b99-bf6b-52baf8aa9d58 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1710 microversion: 2.1 time: 0.357963 Jul 25 05:40:49.494748 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 185/376] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:49 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1710 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:49.808117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-01913a9f-5385-4082-a926-4514725ed1f3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:49.809807 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-01913a9f-5385-4082-a926-4514725ed1f3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:49.816257 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-01913a9f-5385-4082-a926-4514725ed1f3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:49.816831 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-01913a9f-5385-4082-a926-4514725ed1f3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:49.817803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-01913a9f-5385-4082-a926-4514725ed1f3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:49.818209 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-01913a9f-5385-4082-a926-4514725ed1f3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:49.898269 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-01913a9f-5385-4082-a926-4514725ed1f3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:49.906852 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-01913a9f-5385-4082-a926-4514725ed1f3 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1612 microversion: 2.1 time: 0.104146 Jul 25 05:40:49.913499 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 192/377] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:49 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1612 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:49.986394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-e9a73ad0-7ffd-451e-b61a-d1a1f90a8c4c req-e062c405-9638-4742-af4c-75be81845443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5529050b-f2cf-4a8d-a44a-aeeff80f9a44", "name": "network-vif-deleted", "tag": "a17feb40-f712-434b-ab5d-3a419f924bb1"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:40:49.996867 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-e9a73ad0-7ffd-451e-b61a-d1a1f90a8c4c req-e062c405-9638-4742-af4c-75be81845443 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:49.997668 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-e9a73ad0-7ffd-451e-b61a-d1a1f90a8c4c req-e062c405-9638-4742-af4c-75be81845443 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:50.011925 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-e9a73ad0-7ffd-451e-b61a-d1a1f90a8c4c req-e062c405-9638-4742-af4c-75be81845443 service nova] Creating event network-vif-deleted:a17feb40-f712-434b-ab5d-3a419f924bb1 for instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 on hv-cinder-85083 Jul 25 05:40:50.018029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-e9a73ad0-7ffd-451e-b61a-d1a1f90a8c4c req-e062c405-9638-4742-af4c-75be81845443 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035111 Jul 25 05:40:50.018964 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 186/378] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:40:50.511371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e5ccadde-df5b-4201-aa7c-7ded968025cf tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:50.512281 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e5ccadde-df5b-4201-aa7c-7ded968025cf tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:50.518441 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e5ccadde-df5b-4201-aa7c-7ded968025cf tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:50.518883 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e5ccadde-df5b-4201-aa7c-7ded968025cf tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:50.519640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e5ccadde-df5b-4201-aa7c-7ded968025cf tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:50.520080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e5ccadde-df5b-4201-aa7c-7ded968025cf tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:50.653453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e5ccadde-df5b-4201-aa7c-7ded968025cf tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:50.663084 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e5ccadde-df5b-4201-aa7c-7ded968025cf tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1710 microversion: 2.1 time: 0.155532 Jul 25 05:40:50.666685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 193/379] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:50 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:50.927751 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b7469de0-a259-4a38-9cb9-20cdcc358803 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:50.928456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b7469de0-a259-4a38-9cb9-20cdcc358803 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:50.936299 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b7469de0-a259-4a38-9cb9-20cdcc358803 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:50.936766 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b7469de0-a259-4a38-9cb9-20cdcc358803 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:50.937592 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b7469de0-a259-4a38-9cb9-20cdcc358803 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:50.938031 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b7469de0-a259-4a38-9cb9-20cdcc358803 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:50.941012 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:50.974498 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b7469de0-a259-4a38-9cb9-20cdcc358803 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:50.974954 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b7469de0-a259-4a38-9cb9-20cdcc358803 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:50.975417 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-b7469de0-a259-4a38-9cb9-20cdcc358803 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lazy-loading 'fault' on Instance uuid 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:40:51.020012 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b7469de0-a259-4a38-9cb9-20cdcc358803 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:51.028557 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b7469de0-a259-4a38-9cb9-20cdcc358803 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 200 len: 1330 microversion: 2.1 time: 0.107667 Jul 25 05:40:51.029150 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 187/380] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:50 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:51.085470 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3fa5915c-3b4c-4c60-937e-b37cecf2d418 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:51.086045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3fa5915c-3b4c-4c60-937e-b37cecf2d418 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:51.093913 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3fa5915c-3b4c-4c60-937e-b37cecf2d418 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:51.094367 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3fa5915c-3b4c-4c60-937e-b37cecf2d418 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:51.095150 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3fa5915c-3b4c-4c60-937e-b37cecf2d418 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:51.095671 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3fa5915c-3b4c-4c60-937e-b37cecf2d418 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:51.222144 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-3fa5915c-3b4c-4c60-937e-b37cecf2d418 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lazy-loading 'services' on Instance uuid edd0febc-671b-4a39-9dbf-d71d6eb11b32 {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:40:51.345075 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3fa5915c-3b4c-4c60-937e-b37cecf2d418 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "DELETE /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32/os-volume_attachments/727ea29c-538c-441a-a59c-968b24c12f94" status: 202 len: 0 microversion: 2.1 time: 0.263378 Jul 25 05:40:51.345664 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 194/381] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:40:51 2022] DELETE /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32/os-volume_attachments/727ea29c-538c-441a-a59c-968b24c12f94 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:40:51.681009 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-531a0cd0-b410-4273-a017-16fbf81981ab tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:51.682195 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-531a0cd0-b410-4273-a017-16fbf81981ab tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:51.688241 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-531a0cd0-b410-4273-a017-16fbf81981ab tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:51.688700 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-531a0cd0-b410-4273-a017-16fbf81981ab tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:51.689502 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-531a0cd0-b410-4273-a017-16fbf81981ab tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:51.689947 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-531a0cd0-b410-4273-a017-16fbf81981ab tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:51.820616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-531a0cd0-b410-4273-a017-16fbf81981ab tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:51.829302 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-531a0cd0-b410-4273-a017-16fbf81981ab tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1714 microversion: 2.1 time: 0.152129 Jul 25 05:40:51.829803 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 188/382] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:51 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:52.046661 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d2f0a86d-753a-4474-b96c-8bf97ca648c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:52.047368 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d2f0a86d-753a-4474-b96c-8bf97ca648c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:52.053818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2f0a86d-753a-4474-b96c-8bf97ca648c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:52.054268 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2f0a86d-753a-4474-b96c-8bf97ca648c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:52.055033 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2f0a86d-753a-4474-b96c-8bf97ca648c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:52.055471 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d2f0a86d-753a-4474-b96c-8bf97ca648c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:52.069967 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-d2f0a86d-753a-4474-b96c-8bf97ca648c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d2f0a86d-753a-4474-b96c-8bf97ca648c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 HTTP/1.1 Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:40:52.071608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:40:52.073357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '5529050b-f2cf-4a8d-a44a-aeeff80f9a44'} Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:40:52.074113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:40:52.075315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:40:52.076399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d2f0a86d-753a-4474-b96c-8bf97ca648c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:40:52.076399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d2f0a86d-753a-4474-b96c-8bf97ca648c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 404 len: 111 microversion: 2.1 time: 0.030664 Jul 25 05:40:52.077123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 195/383] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:52 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:40:52.082012 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-31a2a2f9-a5d4-4177-b7ca-4d78e596ffb2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '.version_select at 0x7fcc84d69550>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:52.102486 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-31a2a2f9-a5d4-4177-b7ca-4d78e596ffb2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-504096076" status: 202 len: 0 microversion: 2.1 time: 0.024244 Jul 25 05:40:52.103054 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 189/384] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jul 25 05:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-504096076 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:40:52.764962 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f77dd926-37a0-40a0-a734-550c9ffad1a1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:52.765479 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f77dd926-37a0-40a0-a734-550c9ffad1a1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:52.772676 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f77dd926-37a0-40a0-a734-550c9ffad1a1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:52.773165 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f77dd926-37a0-40a0-a734-550c9ffad1a1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:52.773926 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f77dd926-37a0-40a0-a734-550c9ffad1a1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:52.774365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f77dd926-37a0-40a0-a734-550c9ffad1a1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:52.866634 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-f77dd926-37a0-40a0-a734-550c9ffad1a1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lazy-loading 'services' on Instance uuid f5a28e80-5bf2-46af-9ece-8f7d147629fe {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:40:52.938744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f77dd926-37a0-40a0-a734-550c9ffad1a1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments/408b6643-16f3-4433-b331-4698bb311caf" status: 202 len: 0 microversion: 2.1 time: 0.177474 Jul 25 05:40:52.939396 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 196/385] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:40:52 2022] DELETE /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments/408b6643-16f3-4433-b331-4698bb311caf => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:40:52.948576 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-efe2af12-6d34-4aad-bb83-3b030e2630e7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:52.949563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-efe2af12-6d34-4aad-bb83-3b030e2630e7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:52.956336 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-efe2af12-6d34-4aad-bb83-3b030e2630e7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:52.956935 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-efe2af12-6d34-4aad-bb83-3b030e2630e7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:52.957586 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-efe2af12-6d34-4aad-bb83-3b030e2630e7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:52.958042 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-efe2af12-6d34-4aad-bb83-3b030e2630e7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:52.988553 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-efe2af12-6d34-4aad-bb83-3b030e2630e7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044651 Jul 25 05:40:52.989145 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 190/386] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:40:52 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:40:54.001304 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-eacf914a-ffbb-4667-bccd-de032a755608 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:54.002362 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-eacf914a-ffbb-4667-bccd-de032a755608 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:54.008527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eacf914a-ffbb-4667-bccd-de032a755608 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:54.009013 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eacf914a-ffbb-4667-bccd-de032a755608 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:54.010249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eacf914a-ffbb-4667-bccd-de032a755608 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:54.010684 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eacf914a-ffbb-4667-bccd-de032a755608 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:54.039357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-eacf914a-ffbb-4667-bccd-de032a755608 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 Jul 25 05:40:54.039892 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 197/387] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:40:53 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:40:55.051527 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0f5910fc-051e-4e03-85c3-0a215ad894a8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:55.052447 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0f5910fc-051e-4e03-85c3-0a215ad894a8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:55.059499 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0f5910fc-051e-4e03-85c3-0a215ad894a8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:55.059997 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0f5910fc-051e-4e03-85c3-0a215ad894a8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:55.060701 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0f5910fc-051e-4e03-85c3-0a215ad894a8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:55.061164 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0f5910fc-051e-4e03-85c3-0a215ad894a8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:55.089129 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0f5910fc-051e-4e03-85c3-0a215ad894a8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041559 Jul 25 05:40:55.089674 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 191/388] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:40:55 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:40:55.736077 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8c4162e0-493f-4935-869e-7e3197e7b120 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:40:55.737043 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8c4162e0-493f-4935-869e-7e3197e7b120 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:55.743405 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8c4162e0-493f-4935-869e-7e3197e7b120 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:55.743882 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8c4162e0-493f-4935-869e-7e3197e7b120 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:55.744729 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8c4162e0-493f-4935-869e-7e3197e7b120 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:55.745191 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8c4162e0-493f-4935-869e-7e3197e7b120 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:55.767429 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-8c4162e0-493f-4935-869e-7e3197e7b120 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lazy-loading 'flavor' on Instance uuid 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:40:55.931074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8c4162e0-493f-4935-869e-7e3197e7b120 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "POST /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/action" status: 200 len: 32 microversion: 2.1 time: 0.198776 Jul 25 05:40:55.931976 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 198/389] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:40:55 2022] POST /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 05:40:55.940823 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1c08b48e-b5d1-4e80-8d66-73c2e2ffad1d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:55.941443 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1c08b48e-b5d1-4e80-8d66-73c2e2ffad1d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:55.948492 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c08b48e-b5d1-4e80-8d66-73c2e2ffad1d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:55.948492 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c08b48e-b5d1-4e80-8d66-73c2e2ffad1d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:55.949260 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c08b48e-b5d1-4e80-8d66-73c2e2ffad1d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:55.949702 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c08b48e-b5d1-4e80-8d66-73c2e2ffad1d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:56.081637 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1c08b48e-b5d1-4e80-8d66-73c2e2ffad1d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:56.089644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1c08b48e-b5d1-4e80-8d66-73c2e2ffad1d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.152768 Jul 25 05:40:56.090199 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 192/390] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:55 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:56.101970 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f795327b-2cb9-4513-9646-4bebb7a1de25 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:56.102990 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f795327b-2cb9-4513-9646-4bebb7a1de25 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:56.109484 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f795327b-2cb9-4513-9646-4bebb7a1de25 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:56.109968 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f795327b-2cb9-4513-9646-4bebb7a1de25 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:56.110734 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f795327b-2cb9-4513-9646-4bebb7a1de25 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:56.111178 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f795327b-2cb9-4513-9646-4bebb7a1de25 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:56.141475 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f795327b-2cb9-4513-9646-4bebb7a1de25 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Jul 25 05:40:56.142031 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 199/391] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:40:56 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:40:56.699015 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-234aaa2f-ae4c-4131-8383-cf3a34d7cfd2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:56.699548 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-234aaa2f-ae4c-4131-8383-cf3a34d7cfd2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:56.705841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-234aaa2f-ae4c-4131-8383-cf3a34d7cfd2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:56.706292 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-234aaa2f-ae4c-4131-8383-cf3a34d7cfd2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:56.707048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-234aaa2f-ae4c-4131-8383-cf3a34d7cfd2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:56.707485 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-234aaa2f-ae4c-4131-8383-cf3a34d7cfd2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:56.733953 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-234aaa2f-ae4c-4131-8383-cf3a34d7cfd2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:40:56.816231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-234aaa2f-ae4c-4131-8383-cf3a34d7cfd2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "DELETE /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 204 len: 0 microversion: 2.1 time: 0.121862 Jul 25 05:40:56.820915 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 193/392] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:40:56 2022] DELETE /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:40:56.826868 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1a65268b-510b-44b6-aade-d199cad24507 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:56.827625 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1a65268b-510b-44b6-aade-d199cad24507 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:56.836300 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1a65268b-510b-44b6-aade-d199cad24507 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:56.836879 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1a65268b-510b-44b6-aade-d199cad24507 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:56.839011 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1a65268b-510b-44b6-aade-d199cad24507 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:56.839553 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1a65268b-510b-44b6-aade-d199cad24507 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:56.862993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:56.980749 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1a65268b-510b-44b6-aade-d199cad24507 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:56.988249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1a65268b-510b-44b6-aade-d199cad24507 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1514 microversion: 2.1 time: 0.165924 Jul 25 05:40:56.988828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 200/393] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:56 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:57.107284 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-30163b52-849e-4349-b087-7078bb50091a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:57.107979 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-30163b52-849e-4349-b087-7078bb50091a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:57.114436 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-30163b52-849e-4349-b087-7078bb50091a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:57.114890 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-30163b52-849e-4349-b087-7078bb50091a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:57.115643 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-30163b52-849e-4349-b087-7078bb50091a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:57.116081 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-30163b52-849e-4349-b087-7078bb50091a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:57.153390 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-71fa9879-be80-4e17-adde-77fbf01ed648 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:57.154358 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-71fa9879-be80-4e17-adde-77fbf01ed648 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:57.160686 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-71fa9879-be80-4e17-adde-77fbf01ed648 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:57.161167 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-71fa9879-be80-4e17-adde-77fbf01ed648 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:57.161933 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-71fa9879-be80-4e17-adde-77fbf01ed648 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:57.162367 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-71fa9879-be80-4e17-adde-77fbf01ed648 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:57.191856 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-71fa9879-be80-4e17-adde-77fbf01ed648 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042674 Jul 25 05:40:57.192326 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 201/394] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:40:57 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 05:40:57.247631 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-30163b52-849e-4349-b087-7078bb50091a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:57.250010 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e7d6da3a-d979-4129-ace3-d634a72456f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:57.250799 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e7d6da3a-d979-4129-ace3-d634a72456f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:57.255643 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-30163b52-849e-4349-b087-7078bb50091a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.152597 Jul 25 05:40:57.256292 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 194/395] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:57 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:57.257224 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e7d6da3a-d979-4129-ace3-d634a72456f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:57.257674 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e7d6da3a-d979-4129-ace3-d634a72456f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:57.258428 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e7d6da3a-d979-4129-ace3-d634a72456f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:57.258860 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e7d6da3a-d979-4129-ace3-d634a72456f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:57.283996 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e7d6da3a-d979-4129-ace3-d634a72456f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Going to try to terminate instance {{(pid=124467) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:40:57.359251 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e7d6da3a-d979-4129-ace3-d634a72456f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 204 len: 0 microversion: 2.1 time: 0.112708 Jul 25 05:40:57.359823 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 202/396] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:40:57 2022] DELETE /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 05:40:57.367835 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-733a7a86-e5bb-4959-b5a0-8c5112ad0093 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:57.368448 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-733a7a86-e5bb-4959-b5a0-8c5112ad0093 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:57.375445 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-733a7a86-e5bb-4959-b5a0-8c5112ad0093 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:57.375899 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-733a7a86-e5bb-4959-b5a0-8c5112ad0093 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:57.376659 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-733a7a86-e5bb-4959-b5a0-8c5112ad0093 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:57.377143 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-733a7a86-e5bb-4959-b5a0-8c5112ad0093 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:57.752449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-733a7a86-e5bb-4959-b5a0-8c5112ad0093 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:57.760085 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-733a7a86-e5bb-4959-b5a0-8c5112ad0093 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1681 microversion: 2.1 time: 0.395756 Jul 25 05:40:57.760657 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 195/397] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:57 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1681 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:58.006597 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5125a2cb-2dfc-4c13-9cfa-03236550670a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:58.007575 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5125a2cb-2dfc-4c13-9cfa-03236550670a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:58.014945 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5125a2cb-2dfc-4c13-9cfa-03236550670a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:58.015392 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5125a2cb-2dfc-4c13-9cfa-03236550670a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:58.016142 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5125a2cb-2dfc-4c13-9cfa-03236550670a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:58.016574 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5125a2cb-2dfc-4c13-9cfa-03236550670a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:58.144024 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5125a2cb-2dfc-4c13-9cfa-03236550670a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:58.152049 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5125a2cb-2dfc-4c13-9cfa-03236550670a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1514 microversion: 2.1 time: 0.149673 Jul 25 05:40:58.152621 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 203/398] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:58 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:58.272550 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f1f518d0-6155-44e7-8a85-692047f41dc4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:58.273102 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f1f518d0-6155-44e7-8a85-692047f41dc4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:58.279940 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1f518d0-6155-44e7-8a85-692047f41dc4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:58.280396 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1f518d0-6155-44e7-8a85-692047f41dc4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:58.281187 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1f518d0-6155-44e7-8a85-692047f41dc4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:58.281636 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1f518d0-6155-44e7-8a85-692047f41dc4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:58.418088 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f1f518d0-6155-44e7-8a85-692047f41dc4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:58.425981 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f1f518d0-6155-44e7-8a85-692047f41dc4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.157309 Jul 25 05:40:58.426548 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 196/399] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:58 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:58.777020 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-80e592da-ef05-4e98-ac14-a9fd49eccc38 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:58.777627 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-80e592da-ef05-4e98-ac14-a9fd49eccc38 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:58.783529 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80e592da-ef05-4e98-ac14-a9fd49eccc38 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:58.783972 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80e592da-ef05-4e98-ac14-a9fd49eccc38 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:58.784716 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80e592da-ef05-4e98-ac14-a9fd49eccc38 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:58.785180 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80e592da-ef05-4e98-ac14-a9fd49eccc38 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:58.912965 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-80e592da-ef05-4e98-ac14-a9fd49eccc38 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:58.920934 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-80e592da-ef05-4e98-ac14-a9fd49eccc38 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1681 microversion: 2.1 time: 0.147768 Jul 25 05:40:58.921497 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 204/400] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:58 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:40:59.168998 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-12192c71-41fa-4352-b9b2-7fec2fa7e2ca tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:59.169629 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-12192c71-41fa-4352-b9b2-7fec2fa7e2ca tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:59.175632 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-12192c71-41fa-4352-b9b2-7fec2fa7e2ca tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:59.176082 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-12192c71-41fa-4352-b9b2-7fec2fa7e2ca tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:59.176851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-12192c71-41fa-4352-b9b2-7fec2fa7e2ca tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:59.177286 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-12192c71-41fa-4352-b9b2-7fec2fa7e2ca tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:59.304946 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-12192c71-41fa-4352-b9b2-7fec2fa7e2ca tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:59.313256 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-12192c71-41fa-4352-b9b2-7fec2fa7e2ca tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1514 microversion: 2.1 time: 0.148172 Jul 25 05:40:59.313832 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 197/401] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:59 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:59.442946 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-27594e0c-862d-462b-aef4-6eec5646ccf4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:59.443482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-27594e0c-862d-462b-aef4-6eec5646ccf4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:59.449960 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-27594e0c-862d-462b-aef4-6eec5646ccf4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:59.450403 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-27594e0c-862d-462b-aef4-6eec5646ccf4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:59.451148 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-27594e0c-862d-462b-aef4-6eec5646ccf4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:59.451580 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-27594e0c-862d-462b-aef4-6eec5646ccf4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:59.580256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-27594e0c-862d-462b-aef4-6eec5646ccf4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:40:59.589101 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-27594e0c-862d-462b-aef4-6eec5646ccf4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.149996 Jul 25 05:40:59.589673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 205/402] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:59 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:40:59.937851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-eb79722c-339b-4431-8c4b-cbdb1ef04505 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:40:59.938463 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-eb79722c-339b-4431-8c4b-cbdb1ef04505 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:40:59.944375 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eb79722c-339b-4431-8c4b-cbdb1ef04505 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:59.944884 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eb79722c-339b-4431-8c4b-cbdb1ef04505 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:40:59.945640 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eb79722c-339b-4431-8c4b-cbdb1ef04505 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:40:59.946077 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eb79722c-339b-4431-8c4b-cbdb1ef04505 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:00.079469 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-eb79722c-339b-4431-8c4b-cbdb1ef04505 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:00.086967 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-eb79722c-339b-4431-8c4b-cbdb1ef04505 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1681 microversion: 2.1 time: 0.152865 Jul 25 05:41:00.088024 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 198/403] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:40:59 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:00.330520 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-287546fe-d906-44c8-b775-977cf9eda4ff tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:00.331055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-287546fe-d906-44c8-b775-977cf9eda4ff tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:00.337106 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-287546fe-d906-44c8-b775-977cf9eda4ff tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:00.337817 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-287546fe-d906-44c8-b775-977cf9eda4ff tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:00.338565 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-287546fe-d906-44c8-b775-977cf9eda4ff tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:00.338999 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-287546fe-d906-44c8-b775-977cf9eda4ff tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:00.568559 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-287546fe-d906-44c8-b775-977cf9eda4ff tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:00.576918 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-287546fe-d906-44c8-b775-977cf9eda4ff tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1514 microversion: 2.1 time: 0.250196 Jul 25 05:41:00.577850 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 206/404] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:00 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:00.606789 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-159ecf77-f716-4130-9454-50d6a65d6182 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:00.608074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-159ecf77-f716-4130-9454-50d6a65d6182 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:00.614864 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-159ecf77-f716-4130-9454-50d6a65d6182 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:00.615684 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-159ecf77-f716-4130-9454-50d6a65d6182 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:00.616083 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-159ecf77-f716-4130-9454-50d6a65d6182 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:00.616520 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-159ecf77-f716-4130-9454-50d6a65d6182 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:00.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-159ecf77-f716-4130-9454-50d6a65d6182 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:00.838101 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-159ecf77-f716-4130-9454-50d6a65d6182 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.235730 Jul 25 05:41:00.838960 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 199/405] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:00 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:01.004336 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-30552923-68ad-4cee-9f63-dc45fa4addeb req-d5dbfce9-859b-42e2-b6e7-4a320b98e717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd0febc-671b-4a39-9dbf-d71d6eb11b32", "name": "network-vif-deleted", "tag": "9d91bc86-6db7-4b09-b3c9-3958dd762034"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:01.016136 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-30552923-68ad-4cee-9f63-dc45fa4addeb req-d5dbfce9-859b-42e2-b6e7-4a320b98e717 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:01.016680 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-30552923-68ad-4cee-9f63-dc45fa4addeb req-d5dbfce9-859b-42e2-b6e7-4a320b98e717 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:01.029699 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-30552923-68ad-4cee-9f63-dc45fa4addeb req-d5dbfce9-859b-42e2-b6e7-4a320b98e717 service nova] Creating event network-vif-deleted:9d91bc86-6db7-4b09-b3c9-3958dd762034 for instance edd0febc-671b-4a39-9dbf-d71d6eb11b32 on hv-cinder-85083 Jul 25 05:41:01.035105 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-30552923-68ad-4cee-9f63-dc45fa4addeb req-d5dbfce9-859b-42e2-b6e7-4a320b98e717 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034309 Jul 25 05:41:01.035946 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 207/406] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:41:01.105610 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-230bd104-ef68-4b45-88e1-3dd31a9b3aea tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:01.106469 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-230bd104-ef68-4b45-88e1-3dd31a9b3aea tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:01.112873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-230bd104-ef68-4b45-88e1-3dd31a9b3aea tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:01.113334 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-230bd104-ef68-4b45-88e1-3dd31a9b3aea tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:01.114108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-230bd104-ef68-4b45-88e1-3dd31a9b3aea tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:01.114830 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-230bd104-ef68-4b45-88e1-3dd31a9b3aea tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:01.179402 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-230bd104-ef68-4b45-88e1-3dd31a9b3aea tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:01.187836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-230bd104-ef68-4b45-88e1-3dd31a9b3aea tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 200 len: 1613 microversion: 2.1 time: 0.088074 Jul 25 05:41:01.188526 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 200/407] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:01 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:01.280150 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-f3f425d6-62bb-4495-bca8-83c116730ef8 req-0814f256-27a7-48cb-b1e6-513c3758827e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a28e80-5bf2-46af-9ece-8f7d147629fe", "name": "network-vif-deleted", "tag": "96397b18-73bc-4e7f-abf2-2e7a32610b85"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:01.288329 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-f3f425d6-62bb-4495-bca8-83c116730ef8 req-0814f256-27a7-48cb-b1e6-513c3758827e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:01.288870 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-f3f425d6-62bb-4495-bca8-83c116730ef8 req-0814f256-27a7-48cb-b1e6-513c3758827e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:01.300816 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-f3f425d6-62bb-4495-bca8-83c116730ef8 req-0814f256-27a7-48cb-b1e6-513c3758827e service nova] Creating event network-vif-deleted:96397b18-73bc-4e7f-abf2-2e7a32610b85 for instance f5a28e80-5bf2-46af-9ece-8f7d147629fe on hv-cinder-85083 Jul 25 05:41:01.306650 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-f3f425d6-62bb-4495-bca8-83c116730ef8 req-0814f256-27a7-48cb-b1e6-513c3758827e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031024 Jul 25 05:41:01.307319 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 208/408] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:41:01.596138 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bb59d583-c462-4167-887d-37d5242ee343 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:01.597430 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bb59d583-c462-4167-887d-37d5242ee343 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:01.606006 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb59d583-c462-4167-887d-37d5242ee343 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:01.606771 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb59d583-c462-4167-887d-37d5242ee343 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:01.607630 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb59d583-c462-4167-887d-37d5242ee343 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:01.608221 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb59d583-c462-4167-887d-37d5242ee343 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:01.648981 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb59d583-c462-4167-887d-37d5242ee343 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:01.649980 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb59d583-c462-4167-887d-37d5242ee343 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:01.652354 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-bb59d583-c462-4167-887d-37d5242ee343 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lazy-loading 'fault' on Instance uuid edd0febc-671b-4a39-9dbf-d71d6eb11b32 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:41:01.701664 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bb59d583-c462-4167-887d-37d5242ee343 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:01.708899 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bb59d583-c462-4167-887d-37d5242ee343 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 200 len: 1308 microversion: 2.1 time: 0.117225 Jul 25 05:41:01.709402 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 201/409] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:01 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:01.856001 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5397071f-16b5-4de6-ae0c-8700e692f0c1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:01.856729 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5397071f-16b5-4de6-ae0c-8700e692f0c1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:01.863439 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5397071f-16b5-4de6-ae0c-8700e692f0c1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:01.863898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5397071f-16b5-4de6-ae0c-8700e692f0c1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:01.864670 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5397071f-16b5-4de6-ae0c-8700e692f0c1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:01.865142 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5397071f-16b5-4de6-ae0c-8700e692f0c1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:02.003569 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5397071f-16b5-4de6-ae0c-8700e692f0c1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:02.012616 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5397071f-16b5-4de6-ae0c-8700e692f0c1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.160901 Jul 25 05:41:02.013213 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 209/410] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:01 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:02.206413 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-50ce9e4d-59f7-4226-ba04-840969e6fb0f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:02.206413 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-50ce9e4d-59f7-4226-ba04-840969e6fb0f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:02.212374 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50ce9e4d-59f7-4226-ba04-840969e6fb0f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:02.213218 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50ce9e4d-59f7-4226-ba04-840969e6fb0f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:02.214035 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50ce9e4d-59f7-4226-ba04-840969e6fb0f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:02.214681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50ce9e4d-59f7-4226-ba04-840969e6fb0f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:02.229942 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-50ce9e4d-59f7-4226-ba04-840969e6fb0f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-50ce9e4d-59f7-4226-ba04-840969e6fb0f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe HTTP/1.1 Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:41:02.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:41:02.233504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': 'f5a28e80-5bf2-46af-9ece-8f7d147629fe'} Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:41:02.234365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:41:02.235904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:02.238639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-50ce9e4d-59f7-4226-ba04-840969e6fb0f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:41:02.238639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-50ce9e4d-59f7-4226-ba04-840969e6fb0f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 404 len: 111 microversion: 2.1 time: 0.032417 Jul 25 05:41:02.238639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 202/411] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:02 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:41:02.243664 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-615cafdd-7039-4331-b35a-e85573e2682d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '.version_select at 0x7fcc84449af0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:02.267124 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-615cafdd-7039-4331-b35a-e85573e2682d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921352837" status: 202 len: 0 microversion: 2.1 time: 0.027145 Jul 25 05:41:02.267719 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 210/412] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jul 25 05:41:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921352837 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 05:41:02.728734 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ce3ac99f-cb64-425a-a37c-7477ac2674f7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:02.729515 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ce3ac99f-cb64-425a-a37c-7477ac2674f7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: edd0febc-671b-4a39-9dbf-d71d6eb11b32] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:02.737710 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ce3ac99f-cb64-425a-a37c-7477ac2674f7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:02.738164 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ce3ac99f-cb64-425a-a37c-7477ac2674f7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:02.738932 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ce3ac99f-cb64-425a-a37c-7477ac2674f7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:02.739366 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ce3ac99f-cb64-425a-a37c-7477ac2674f7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:02.745098 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:02.758993 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-ce3ac99f-cb64-425a-a37c-7477ac2674f7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] HTTP exception thrown: Instance edd0febc-671b-4a39-9dbf-d71d6eb11b32 could not be found. Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ce3ac99f-cb64-425a-a37c-7477ac2674f7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Request method failure captured: Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 HTTP/1.1 Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iyJL2Zbz0Bdze70DEvJJEbsn363JEYG3m7pZz1BSV7ypZ13ix9GQj6Hn1IJFwktmPrXzYdzn9-OV4B6ns5yltL3O0mnf4nJ5uNji1KHCblauy7OfnKFqtmGkKs9nr-OYpMldsC4abfsnU0DW58YuUMeQnE7ZWti98PoGORrXWYON5g Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 213b3114e35d4016b3169364760edb17 Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1963100190 Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:41:02.761325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/213b3114e35d4016b3169364760edb17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/213b3114e35d4016b3169364760edb17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/213b3114e35d4016b3169364760edb17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_213b3114e35d4016b3169364760edb17"}]}] Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesSnapshotTestJSON-1963100190 Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 213b3114e35d4016b3169364760edb17 Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1963100190 Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesSnapshotTestJSON-1963100190-project Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: ce0944d760224239bd16aa0981db0eec Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesSnapshotTestJSON-1963100190-project Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance edd0febc-671b-4a39-9dbf-d71d6eb11b32 could not be found. Jul 25 05:41:02.763259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': 'edd0febc-671b-4a39-9dbf-d71d6eb11b32'} Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd0febc-671b-4a39-9dbf-d71d6eb11b32 could not be found. Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:41:02.764306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd0febc-671b-4a39-9dbf-d71d6eb11b32 could not be found. Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd0febc-671b-4a39-9dbf-d71d6eb11b32 could not be found. Jul 25 05:41:02.765532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:02.768234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ce3ac99f-cb64-425a-a37c-7477ac2674f7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Returning 404 to user: Instance edd0febc-671b-4a39-9dbf-d71d6eb11b32 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:41:02.768234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ce3ac99f-cb64-425a-a37c-7477ac2674f7 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32" status: 404 len: 111 microversion: 2.1 time: 0.039848 Jul 25 05:41:02.768234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 203/413] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:02 2022] GET /compute/v2.1/servers/edd0febc-671b-4a39-9dbf-d71d6eb11b32 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:41:03.021040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-409de55a-77f9-43e3-9f17-8aeebf0eee1f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: .version_select at 0x7fcc843b0a60>, body: {"keypair": {"name": "tempest-keypair-1557419831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/OBMhBUe87TYqQ3n0DF1PrjZy05K6nr0Tin1/xg5fNCLPL5ENJHxCgfKSOtc9ah4doLsFVW8Yobmu79QxcMsw1kMjM2ich1daZMTSaODX26qCvd2XRkzzrDueeibxnjw=="}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:03.029372 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-45a1a334-55ef-440a-b17d-5196e41d516f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:03.029976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-45a1a334-55ef-440a-b17d-5196e41d516f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:03.036365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45a1a334-55ef-440a-b17d-5196e41d516f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:03.036615 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-409de55a-77f9-43e3-9f17-8aeebf0eee1f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:41:03.036848 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45a1a334-55ef-440a-b17d-5196e41d516f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:03.037610 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45a1a334-55ef-440a-b17d-5196e41d516f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:03.038046 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45a1a334-55ef-440a-b17d-5196e41d516f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:03.040464 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-409de55a-77f9-43e3-9f17-8aeebf0eee1f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for user 69f3276517de4f889dddd3180436ede9 and project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:41:03.063018 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-409de55a-77f9-43e3-9f17-8aeebf0eee1f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045866 Jul 25 05:41:03.063625 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 211/414] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 25 05:41:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:41:03.179669 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-45a1a334-55ef-440a-b17d-5196e41d516f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:03.187769 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-45a1a334-55ef-440a-b17d-5196e41d516f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.162747 Jul 25 05:41:03.188738 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 204/415] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:03 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:04.206549 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-310ab7b1-c8aa-47f8-9ffa-4175c6e626d3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:04.207287 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-310ab7b1-c8aa-47f8-9ffa-4175c6e626d3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:04.213672 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-310ab7b1-c8aa-47f8-9ffa-4175c6e626d3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:04.214125 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-310ab7b1-c8aa-47f8-9ffa-4175c6e626d3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:04.214881 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-310ab7b1-c8aa-47f8-9ffa-4175c6e626d3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:04.215318 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-310ab7b1-c8aa-47f8-9ffa-4175c6e626d3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:04.349668 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-310ab7b1-c8aa-47f8-9ffa-4175c6e626d3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:04.358450 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-310ab7b1-c8aa-47f8-9ffa-4175c6e626d3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.156213 Jul 25 05:41:04.359028 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 212/416] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:04 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:04.560221 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1949468094", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fec420c3-be12-4a0c-92d9-7ad0ead1f91c"}], "security_groups": [{"name": "tempest-securitygroup--806001128"}], "key_name": "tempest-keypair-1557419831", "user_data": "}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:04.659751 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] validate_networks() for [('fec420c3-be12-4a0c-92d9-7ad0ead1f91c', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:41:05.021847 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:41:05.022278 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:41:05.022759 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:41:05.023228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:41:05.023648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:41:05.032690 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:05.033174 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:05.033981 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:05.034427 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:05.050988 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:41:05.055592 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for user 69f3276517de4f889dddd3180436ede9 and project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:41:05.067237 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:41:05.069433 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:41:05.117359 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8aa68654-1cb3-49c0-aa2f-9b28e674606d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.561406 Jul 25 05:41:05.118006 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 205/417] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:41:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:41:05.128666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-55a5970a-d4a5-43d1-b387-c90964e4f713 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:05.129327 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-55a5970a-d4a5-43d1-b387-c90964e4f713 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:05.183647 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-55a5970a-d4a5-43d1-b387-c90964e4f713 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:05.190191 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-55a5970a-d4a5-43d1-b387-c90964e4f713 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1242 microversion: 2.1 time: 0.065287 Jul 25 05:41:05.190782 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 213/418] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:05 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:05.376121 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4754388d-fae8-497e-8c16-fb6456a47680 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:05.376892 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4754388d-fae8-497e-8c16-fb6456a47680 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:05.384080 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4754388d-fae8-497e-8c16-fb6456a47680 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:05.384634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4754388d-fae8-497e-8c16-fb6456a47680 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:05.386324 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4754388d-fae8-497e-8c16-fb6456a47680 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:05.386774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4754388d-fae8-497e-8c16-fb6456a47680 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:05.526839 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4754388d-fae8-497e-8c16-fb6456a47680 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:05.534698 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4754388d-fae8-497e-8c16-fb6456a47680 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.162524 Jul 25 05:41:05.535251 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 206/419] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:05 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:06.207980 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-35e60a18-2ab3-47e0-99d7-76747410b632 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:06.208597 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-35e60a18-2ab3-47e0-99d7-76747410b632 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:06.215436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-35e60a18-2ab3-47e0-99d7-76747410b632 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:06.215897 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-35e60a18-2ab3-47e0-99d7-76747410b632 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:06.216671 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-35e60a18-2ab3-47e0-99d7-76747410b632 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:06.217141 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-35e60a18-2ab3-47e0-99d7-76747410b632 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:06.285356 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-35e60a18-2ab3-47e0-99d7-76747410b632 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:06.293513 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-35e60a18-2ab3-47e0-99d7-76747410b632 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1294 microversion: 2.1 time: 0.089295 Jul 25 05:41:06.294070 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 214/420] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:06 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:06.551485 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-50f82e55-fc34-4628-bef4-ce6ed8d52929 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:06.552389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-50f82e55-fc34-4628-bef4-ce6ed8d52929 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:06.559012 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50f82e55-fc34-4628-bef4-ce6ed8d52929 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:06.559576 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50f82e55-fc34-4628-bef4-ce6ed8d52929 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:06.560454 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50f82e55-fc34-4628-bef4-ce6ed8d52929 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:06.561007 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50f82e55-fc34-4628-bef4-ce6ed8d52929 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:06.698430 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-50f82e55-fc34-4628-bef4-ce6ed8d52929 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:06.706600 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-50f82e55-fc34-4628-bef4-ce6ed8d52929 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.159017 Jul 25 05:41:06.707171 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 207/421] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:06 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:07.311201 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-0deb5ec3-ab86-4f70-bb13-b3186e47bbfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:07.311812 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-0deb5ec3-ab86-4f70-bb13-b3186e47bbfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:07.314282 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:07.330230 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0deb5ec3-ab86-4f70-bb13-b3186e47bbfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:07.330872 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0deb5ec3-ab86-4f70-bb13-b3186e47bbfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:07.331812 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0deb5ec3-ab86-4f70-bb13-b3186e47bbfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:07.332406 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0deb5ec3-ab86-4f70-bb13-b3186e47bbfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:07.531019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-0deb5ec3-ab86-4f70-bb13-b3186e47bbfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:07.538649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-0deb5ec3-ab86-4f70-bb13-b3186e47bbfc tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1367 microversion: 2.1 time: 0.231950 Jul 25 05:41:07.539239 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 215/422] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:07 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:07.725236 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-83bdb8fa-38aa-400e-a699-afd10b8bd86d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:07.726517 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-83bdb8fa-38aa-400e-a699-afd10b8bd86d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:07.734695 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83bdb8fa-38aa-400e-a699-afd10b8bd86d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:07.735584 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83bdb8fa-38aa-400e-a699-afd10b8bd86d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:07.736352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83bdb8fa-38aa-400e-a699-afd10b8bd86d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:07.736909 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83bdb8fa-38aa-400e-a699-afd10b8bd86d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:07.882657 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-83bdb8fa-38aa-400e-a699-afd10b8bd86d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:07.891396 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-83bdb8fa-38aa-400e-a699-afd10b8bd86d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.170326 Jul 25 05:41:07.891980 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 208/423] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:07 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:08.048408 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-6108a005-d988-45c7-bbff-546eca2bcf03 req-a2a4ca57-80db-47fd-b9c0-dd841662e6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0ce9ee-f993-48f3-81da-8a31b0a2fc21", "tag": "1d7fd591-303f-4f00-9657-b9203d5271ba"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:08.057354 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-6108a005-d988-45c7-bbff-546eca2bcf03 req-a2a4ca57-80db-47fd-b9c0-dd841662e6f5 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:08.057895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-6108a005-d988-45c7-bbff-546eca2bcf03 req-a2a4ca57-80db-47fd-b9c0-dd841662e6f5 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:08.069883 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-6108a005-d988-45c7-bbff-546eca2bcf03 req-a2a4ca57-80db-47fd-b9c0-dd841662e6f5 service nova] Creating event network-changed:1d7fd591-303f-4f00-9657-b9203d5271ba for instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 on hv-cinder-85083 Jul 25 05:41:08.076082 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-6108a005-d988-45c7-bbff-546eca2bcf03 req-a2a4ca57-80db-47fd-b9c0-dd841662e6f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031263 Jul 25 05:41:08.076687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 216/424] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:41:08.556481 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a5aea39e-4d93-4a81-a0b8-a90d0fcf3d86 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:08.557643 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a5aea39e-4d93-4a81-a0b8-a90d0fcf3d86 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:08.563597 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a5aea39e-4d93-4a81-a0b8-a90d0fcf3d86 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:08.564046 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a5aea39e-4d93-4a81-a0b8-a90d0fcf3d86 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:08.564825 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a5aea39e-4d93-4a81-a0b8-a90d0fcf3d86 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:08.565265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a5aea39e-4d93-4a81-a0b8-a90d0fcf3d86 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:08.695404 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a5aea39e-4d93-4a81-a0b8-a90d0fcf3d86 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:08.703537 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a5aea39e-4d93-4a81-a0b8-a90d0fcf3d86 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1367 microversion: 2.1 time: 0.150933 Jul 25 05:41:08.704093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 209/425] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:08 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:08.909153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3e472018-8c40-494b-a4ca-1a57c1726599 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:08.909863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3e472018-8c40-494b-a4ca-1a57c1726599 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:08.916205 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3e472018-8c40-494b-a4ca-1a57c1726599 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:08.916668 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3e472018-8c40-494b-a4ca-1a57c1726599 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:08.917462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3e472018-8c40-494b-a4ca-1a57c1726599 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:08.917908 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3e472018-8c40-494b-a4ca-1a57c1726599 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:09.047330 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3e472018-8c40-494b-a4ca-1a57c1726599 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:09.055665 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3e472018-8c40-494b-a4ca-1a57c1726599 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.150763 Jul 25 05:41:09.056228 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 217/426] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:08 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:09.720217 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1c6f4a53-98c1-438c-894b-5b6dbe9c3d5d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:09.720771 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1c6f4a53-98c1-438c-894b-5b6dbe9c3d5d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:09.723044 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:09.729143 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c6f4a53-98c1-438c-894b-5b6dbe9c3d5d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:09.729898 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c6f4a53-98c1-438c-894b-5b6dbe9c3d5d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:09.730674 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c6f4a53-98c1-438c-894b-5b6dbe9c3d5d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:09.731123 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c6f4a53-98c1-438c-894b-5b6dbe9c3d5d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:09.865807 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1c6f4a53-98c1-438c-894b-5b6dbe9c3d5d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:09.873260 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1c6f4a53-98c1-438c-894b-5b6dbe9c3d5d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1367 microversion: 2.1 time: 0.156877 Jul 25 05:41:09.874015 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 210/427] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:09 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:10.073830 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b5e893f4-58c6-44e5-ad8f-a98c17d5fe10 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:10.074482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b5e893f4-58c6-44e5-ad8f-a98c17d5fe10 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:10.080961 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b5e893f4-58c6-44e5-ad8f-a98c17d5fe10 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:10.081428 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b5e893f4-58c6-44e5-ad8f-a98c17d5fe10 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:10.082193 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b5e893f4-58c6-44e5-ad8f-a98c17d5fe10 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:10.082638 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b5e893f4-58c6-44e5-ad8f-a98c17d5fe10 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:10.210806 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b5e893f4-58c6-44e5-ad8f-a98c17d5fe10 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:10.219750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b5e893f4-58c6-44e5-ad8f-a98c17d5fe10 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.150249 Jul 25 05:41:10.220315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 218/428] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:10 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:10.657503 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1964808996", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "networks": [{"uuid": "bc35280f-d3fa-4a8e-8f13-e8e0a7a52950"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:10.707423 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] validate_networks() for [('bc35280f-d3fa-4a8e-8f13-e8e0a7a52950', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:41:10.890607 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-df1c9d67-0857-445f-937e-3763f732c14e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:10.891213 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-df1c9d67-0857-445f-937e-3763f732c14e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:10.897197 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-df1c9d67-0857-445f-937e-3763f732c14e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:10.897643 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-df1c9d67-0857-445f-937e-3763f732c14e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:10.898497 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-df1c9d67-0857-445f-937e-3763f732c14e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:10.898867 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-df1c9d67-0857-445f-937e-3763f732c14e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:11.099149 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-df1c9d67-0857-445f-937e-3763f732c14e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:11.108447 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-df1c9d67-0857-445f-937e-3763f732c14e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1367 microversion: 2.1 time: 0.221140 Jul 25 05:41:11.109021 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 219/429] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:10 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:11.126669 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:41:11.127169 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:41:11.127549 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:41:11.127956 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:41:11.128365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:41:11.137788 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:11.138245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:11.139034 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:11.139465 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:11.156274 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Getting quotas for project 213b3114e35d4016b3169364760edb17. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:41:11.159938 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Getting quotas for user ce0944d760224239bd16aa0981db0eec and project 213b3114e35d4016b3169364760edb17. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:41:11.170892 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:41:11.173031 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:41:11.217813 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6feed907-62f6-47b5-89c4-7584f36247da tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564251 Jul 25 05:41:11.218772 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 211/430] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:41:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:41:11.228573 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1e544a3b-0d71-4a21-b2a2-867457c71a72 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:11.229471 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1e544a3b-0d71-4a21-b2a2-867457c71a72 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:11.237209 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a51e2cf5-5c4d-48d3-aeed-a22a37cab14b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:11.238259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a51e2cf5-5c4d-48d3-aeed-a22a37cab14b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:11.245545 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a51e2cf5-5c4d-48d3-aeed-a22a37cab14b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:11.246916 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a51e2cf5-5c4d-48d3-aeed-a22a37cab14b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:11.248045 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a51e2cf5-5c4d-48d3-aeed-a22a37cab14b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:11.248697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a51e2cf5-5c4d-48d3-aeed-a22a37cab14b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:11.301331 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1e544a3b-0d71-4a21-b2a2-867457c71a72 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:11.310887 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1e544a3b-0d71-4a21-b2a2-867457c71a72 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1219 microversion: 2.1 time: 0.086401 Jul 25 05:41:11.318132 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 220/431] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:11 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:11.404731 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a51e2cf5-5c4d-48d3-aeed-a22a37cab14b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:11.413646 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a51e2cf5-5c4d-48d3-aeed-a22a37cab14b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.180558 Jul 25 05:41:11.414232 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 212/432] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:11 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:12.125192 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3051c7da-d8ef-4d2c-8070-7386d02a27a9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:12.125808 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3051c7da-d8ef-4d2c-8070-7386d02a27a9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:12.132291 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3051c7da-d8ef-4d2c-8070-7386d02a27a9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:12.132768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3051c7da-d8ef-4d2c-8070-7386d02a27a9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:12.133547 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3051c7da-d8ef-4d2c-8070-7386d02a27a9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:12.133986 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3051c7da-d8ef-4d2c-8070-7386d02a27a9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:12.149503 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:12.266332 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3051c7da-d8ef-4d2c-8070-7386d02a27a9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:12.274280 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3051c7da-d8ef-4d2c-8070-7386d02a27a9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1367 microversion: 2.1 time: 0.152941 Jul 25 05:41:12.274832 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 221/433] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:12 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:12.330248 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-26381784-177f-4753-90cc-cb5008e1e3ad tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:12.330857 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-26381784-177f-4753-90cc-cb5008e1e3ad tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:12.337229 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-26381784-177f-4753-90cc-cb5008e1e3ad tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:12.337680 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-26381784-177f-4753-90cc-cb5008e1e3ad tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:12.339077 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-26381784-177f-4753-90cc-cb5008e1e3ad tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:12.339510 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-26381784-177f-4753-90cc-cb5008e1e3ad tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:12.398614 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-26381784-177f-4753-90cc-cb5008e1e3ad tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:12.406560 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-26381784-177f-4753-90cc-cb5008e1e3ad tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1223 microversion: 2.1 time: 0.080091 Jul 25 05:41:12.407114 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 213/434] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:12 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:12.431217 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-188d6612-29ce-4514-9441-b6acd75216a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:12.432301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-188d6612-29ce-4514-9441-b6acd75216a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:12.438232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-188d6612-29ce-4514-9441-b6acd75216a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:12.438678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-188d6612-29ce-4514-9441-b6acd75216a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:12.439426 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-188d6612-29ce-4514-9441-b6acd75216a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:12.439974 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-188d6612-29ce-4514-9441-b6acd75216a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:12.576405 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-188d6612-29ce-4514-9441-b6acd75216a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:12.584334 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-188d6612-29ce-4514-9441-b6acd75216a0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.156898 Jul 25 05:41:12.584913 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 222/435] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:12 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:13.292855 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2660b461-1ded-45a5-9bbc-111599abc168 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:13.293586 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2660b461-1ded-45a5-9bbc-111599abc168 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:13.300090 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2660b461-1ded-45a5-9bbc-111599abc168 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:13.300585 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2660b461-1ded-45a5-9bbc-111599abc168 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:13.301865 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2660b461-1ded-45a5-9bbc-111599abc168 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:13.302364 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2660b461-1ded-45a5-9bbc-111599abc168 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:13.423663 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8f70c1fd-33ce-449f-9136-0d939e7809a2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:13.424383 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8f70c1fd-33ce-449f-9136-0d939e7809a2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:13.431197 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8f70c1fd-33ce-449f-9136-0d939e7809a2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:13.431770 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8f70c1fd-33ce-449f-9136-0d939e7809a2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:13.432616 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8f70c1fd-33ce-449f-9136-0d939e7809a2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:13.433155 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8f70c1fd-33ce-449f-9136-0d939e7809a2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:13.438458 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2660b461-1ded-45a5-9bbc-111599abc168 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:13.446061 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2660b461-1ded-45a5-9bbc-111599abc168 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1367 microversion: 2.1 time: 0.158498 Jul 25 05:41:13.446876 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 214/436] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:13 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:13.513000 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8f70c1fd-33ce-449f-9136-0d939e7809a2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:13.520902 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8f70c1fd-33ce-449f-9136-0d939e7809a2 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1277 microversion: 2.1 time: 0.101244 Jul 25 05:41:13.521515 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 223/437] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:13 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:13.602400 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b5f5619e-a0a5-43b3-a611-0893efd7105b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:13.603020 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b5f5619e-a0a5-43b3-a611-0893efd7105b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:13.609621 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b5f5619e-a0a5-43b3-a611-0893efd7105b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:13.610083 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b5f5619e-a0a5-43b3-a611-0893efd7105b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:13.610857 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b5f5619e-a0a5-43b3-a611-0893efd7105b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:13.611305 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b5f5619e-a0a5-43b3-a611-0893efd7105b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:13.743341 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b5f5619e-a0a5-43b3-a611-0893efd7105b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:13.752254 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b5f5619e-a0a5-43b3-a611-0893efd7105b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.153714 Jul 25 05:41:13.757472 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 215/438] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:13 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:14.436808 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-df8d5797-b29b-4c11-be34-d2fd3be8613c req-64bf3264-9159-4521-87b8-cf7df39d5933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdeb60d1-2ee4-4e65-a46e-ae8aa153568c", "tag": "be4aadad-fae4-45d9-9f06-a8c23366b5c2"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:14.448336 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-df8d5797-b29b-4c11-be34-d2fd3be8613c req-64bf3264-9159-4521-87b8-cf7df39d5933 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:14.449086 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-df8d5797-b29b-4c11-be34-d2fd3be8613c req-64bf3264-9159-4521-87b8-cf7df39d5933 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:14.465008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f067a1bc-a28f-4edc-accc-2621ac0a5c84 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:14.465726 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f067a1bc-a28f-4edc-accc-2621ac0a5c84 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:14.473997 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f067a1bc-a28f-4edc-accc-2621ac0a5c84 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:14.474849 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f067a1bc-a28f-4edc-accc-2621ac0a5c84 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:14.475851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f067a1bc-a28f-4edc-accc-2621ac0a5c84 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:14.476398 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f067a1bc-a28f-4edc-accc-2621ac0a5c84 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:14.480037 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-df8d5797-b29b-4c11-be34-d2fd3be8613c req-64bf3264-9159-4521-87b8-cf7df39d5933 service nova] Creating event network-changed:be4aadad-fae4-45d9-9f06-a8c23366b5c2 for instance fdeb60d1-2ee4-4e65-a46e-ae8aa153568c on hv-cinder-85083 Jul 25 05:41:14.485568 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-df8d5797-b29b-4c11-be34-d2fd3be8613c req-64bf3264-9159-4521-87b8-cf7df39d5933 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052794 Jul 25 05:41:14.486417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 224/439] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:41:14.539947 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-dd61df00-702c-4616-a07b-9108afc61aa1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:14.541632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-dd61df00-702c-4616-a07b-9108afc61aa1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:14.554611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd61df00-702c-4616-a07b-9108afc61aa1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:14.555475 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd61df00-702c-4616-a07b-9108afc61aa1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:14.558175 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd61df00-702c-4616-a07b-9108afc61aa1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:14.559731 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd61df00-702c-4616-a07b-9108afc61aa1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:14.669621 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f067a1bc-a28f-4edc-accc-2621ac0a5c84 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:14.678434 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f067a1bc-a28f-4edc-accc-2621ac0a5c84 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1367 microversion: 2.1 time: 0.219287 Jul 25 05:41:14.680077 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 216/440] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:14 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:14.731110 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-dd61df00-702c-4616-a07b-9108afc61aa1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:14.738601 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-dd61df00-702c-4616-a07b-9108afc61aa1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1319 microversion: 2.1 time: 0.204525 Jul 25 05:41:14.739168 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 225/441] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:14 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:14.770186 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5a02cc8f-0321-4f7e-b9bf-256226612cfd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:14.770902 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5a02cc8f-0321-4f7e-b9bf-256226612cfd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:14.777085 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a02cc8f-0321-4f7e-b9bf-256226612cfd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:14.777641 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a02cc8f-0321-4f7e-b9bf-256226612cfd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:14.778413 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a02cc8f-0321-4f7e-b9bf-256226612cfd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:14.778856 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a02cc8f-0321-4f7e-b9bf-256226612cfd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:14.913321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5a02cc8f-0321-4f7e-b9bf-256226612cfd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:14.921798 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5a02cc8f-0321-4f7e-b9bf-256226612cfd tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.155358 Jul 25 05:41:14.922388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 217/442] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:14 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:15.695387 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-fbec29ce-793c-4ecc-8c65-627b067200d9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:15.695995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-fbec29ce-793c-4ecc-8c65-627b067200d9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:15.703209 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fbec29ce-793c-4ecc-8c65-627b067200d9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:15.703653 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fbec29ce-793c-4ecc-8c65-627b067200d9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:15.704401 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fbec29ce-793c-4ecc-8c65-627b067200d9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:15.704856 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fbec29ce-793c-4ecc-8c65-627b067200d9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:15.755818 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d10bfce2-7f01-43ef-a08f-137676c3958a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:15.756431 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d10bfce2-7f01-43ef-a08f-137676c3958a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:15.763581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d10bfce2-7f01-43ef-a08f-137676c3958a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:15.764033 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d10bfce2-7f01-43ef-a08f-137676c3958a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:15.764802 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d10bfce2-7f01-43ef-a08f-137676c3958a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:15.765250 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d10bfce2-7f01-43ef-a08f-137676c3958a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:15.871688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-fbec29ce-793c-4ecc-8c65-627b067200d9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:15.879351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-fbec29ce-793c-4ecc-8c65-627b067200d9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1367 microversion: 2.1 time: 0.187752 Jul 25 05:41:15.880009 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 226/443] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:15 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:15.915741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d10bfce2-7f01-43ef-a08f-137676c3958a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:15.923675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d10bfce2-7f01-43ef-a08f-137676c3958a tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1319 microversion: 2.1 time: 0.171892 Jul 25 05:41:15.924223 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 218/444] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:15 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:15.938696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b39e8bee-1cb0-4133-9f08-8462ac7dcce3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:15.939300 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b39e8bee-1cb0-4133-9f08-8462ac7dcce3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:15.945301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b39e8bee-1cb0-4133-9f08-8462ac7dcce3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:15.945797 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b39e8bee-1cb0-4133-9f08-8462ac7dcce3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:15.946498 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b39e8bee-1cb0-4133-9f08-8462ac7dcce3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:15.946931 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b39e8bee-1cb0-4133-9f08-8462ac7dcce3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:16.077383 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b39e8bee-1cb0-4133-9f08-8462ac7dcce3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:16.085306 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b39e8bee-1cb0-4133-9f08-8462ac7dcce3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.150388 Jul 25 05:41:16.085876 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 227/445] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:15 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:16.555703 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-ca61053d-5791-40c1-a6b8-cc147ab7d648 req-2b2dfe54-4002-42ce-b00a-0f35e1cdca9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0ce9ee-f993-48f3-81da-8a31b0a2fc21", "name": "network-vif-plugged", "status": "completed", "tag": "1d7fd591-303f-4f00-9657-b9203d5271ba"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:16.564287 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ca61053d-5791-40c1-a6b8-cc147ab7d648 req-2b2dfe54-4002-42ce-b00a-0f35e1cdca9e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:16.564840 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ca61053d-5791-40c1-a6b8-cc147ab7d648 req-2b2dfe54-4002-42ce-b00a-0f35e1cdca9e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:16.576557 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-ca61053d-5791-40c1-a6b8-cc147ab7d648 req-2b2dfe54-4002-42ce-b00a-0f35e1cdca9e service nova] Creating event network-vif-plugged:1d7fd591-303f-4f00-9657-b9203d5271ba for instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 on hv-cinder-85083 Jul 25 05:41:16.581558 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-ca61053d-5791-40c1-a6b8-cc147ab7d648 req-2b2dfe54-4002-42ce-b00a-0f35e1cdca9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029550 Jul 25 05:41:16.582200 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 219/446] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:41:16.895371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b8f9e93a-f835-4e9c-a668-f649f34eb9ba tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:16.895987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b8f9e93a-f835-4e9c-a668-f649f34eb9ba tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:16.903315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b8f9e93a-f835-4e9c-a668-f649f34eb9ba tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:16.903771 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b8f9e93a-f835-4e9c-a668-f649f34eb9ba tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:16.904534 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b8f9e93a-f835-4e9c-a668-f649f34eb9ba tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:16.905024 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b8f9e93a-f835-4e9c-a668-f649f34eb9ba tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:16.941730 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-02ff62ed-0572-4fbf-a931-eff573e38822 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:16.942434 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-02ff62ed-0572-4fbf-a931-eff573e38822 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:16.949443 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02ff62ed-0572-4fbf-a931-eff573e38822 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:16.949911 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02ff62ed-0572-4fbf-a931-eff573e38822 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:16.950662 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02ff62ed-0572-4fbf-a931-eff573e38822 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:16.951095 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02ff62ed-0572-4fbf-a931-eff573e38822 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:17.086190 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b8f9e93a-f835-4e9c-a668-f649f34eb9ba tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:17.095091 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b8f9e93a-f835-4e9c-a668-f649f34eb9ba tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1367 microversion: 2.1 time: 0.203494 Jul 25 05:41:17.095787 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 228/447] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:16 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:17.110067 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-07674331-aad2-43e1-8e6f-d6d8c1b79a7f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:17.110677 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-07674331-aad2-43e1-8e6f-d6d8c1b79a7f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:17.115064 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-02ff62ed-0572-4fbf-a931-eff573e38822 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:17.116699 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-07674331-aad2-43e1-8e6f-d6d8c1b79a7f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:17.117184 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-07674331-aad2-43e1-8e6f-d6d8c1b79a7f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:17.117947 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-07674331-aad2-43e1-8e6f-d6d8c1b79a7f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:17.118511 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-07674331-aad2-43e1-8e6f-d6d8c1b79a7f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:17.122556 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-02ff62ed-0572-4fbf-a931-eff573e38822 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1319 microversion: 2.1 time: 0.185412 Jul 25 05:41:17.123116 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 220/448] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:16 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:17.248510 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-07674331-aad2-43e1-8e6f-d6d8c1b79a7f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:17.256326 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-07674331-aad2-43e1-8e6f-d6d8c1b79a7f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.150103 Jul 25 05:41:17.256912 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 229/449] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:17 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:18.112676 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1081935e-c064-4a40-841a-eae463a29d37 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:18.113274 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1081935e-c064-4a40-841a-eae463a29d37 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:18.119783 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1081935e-c064-4a40-841a-eae463a29d37 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:18.120240 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1081935e-c064-4a40-841a-eae463a29d37 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:18.121047 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1081935e-c064-4a40-841a-eae463a29d37 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:18.121491 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1081935e-c064-4a40-841a-eae463a29d37 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:18.139609 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1cfe6c8c-e035-4ec5-bd2d-f7fd48d6150e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:18.140210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1cfe6c8c-e035-4ec5-bd2d-f7fd48d6150e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:18.146641 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1cfe6c8c-e035-4ec5-bd2d-f7fd48d6150e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:18.147088 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1cfe6c8c-e035-4ec5-bd2d-f7fd48d6150e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:18.147837 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1cfe6c8c-e035-4ec5-bd2d-f7fd48d6150e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:18.148269 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1cfe6c8c-e035-4ec5-bd2d-f7fd48d6150e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:18.310923 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1081935e-c064-4a40-841a-eae463a29d37 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:18.318265 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1081935e-c064-4a40-841a-eae463a29d37 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1367 microversion: 2.1 time: 0.209551 Jul 25 05:41:18.318893 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 221/450] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:18 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:18.324002 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-658a4d90-56ae-4150-9937-96ac534a845f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:18.324605 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-658a4d90-56ae-4150-9937-96ac534a845f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:18.326192 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1cfe6c8c-e035-4ec5-bd2d-f7fd48d6150e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:18.330430 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-658a4d90-56ae-4150-9937-96ac534a845f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:18.330881 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-658a4d90-56ae-4150-9937-96ac534a845f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:18.331678 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-658a4d90-56ae-4150-9937-96ac534a845f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:18.332117 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-658a4d90-56ae-4150-9937-96ac534a845f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:18.334173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1cfe6c8c-e035-4ec5-bd2d-f7fd48d6150e tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1319 microversion: 2.1 time: 0.198376 Jul 25 05:41:18.334738 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 230/451] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:18 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:18.347486 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:18.464453 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-658a4d90-56ae-4150-9937-96ac534a845f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:18.472304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-658a4d90-56ae-4150-9937-96ac534a845f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.152533 Jul 25 05:41:18.472885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 222/452] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:18 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:19.335428 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3fb22aa1-7336-4da3-8302-c8bffbced29c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:19.336036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3fb22aa1-7336-4da3-8302-c8bffbced29c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:19.343685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3fb22aa1-7336-4da3-8302-c8bffbced29c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:19.344129 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3fb22aa1-7336-4da3-8302-c8bffbced29c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:19.344910 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3fb22aa1-7336-4da3-8302-c8bffbced29c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:19.345342 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3fb22aa1-7336-4da3-8302-c8bffbced29c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:19.351594 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-11591959-82b5-4068-9c14-a096bcaabc30 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:19.352319 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-11591959-82b5-4068-9c14-a096bcaabc30 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:19.359533 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11591959-82b5-4068-9c14-a096bcaabc30 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:19.359990 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11591959-82b5-4068-9c14-a096bcaabc30 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:19.360761 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11591959-82b5-4068-9c14-a096bcaabc30 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:19.361230 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11591959-82b5-4068-9c14-a096bcaabc30 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:19.547615 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3fb22aa1-7336-4da3-8302-c8bffbced29c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:19.550897 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-11591959-82b5-4068-9c14-a096bcaabc30 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:19.555095 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3fb22aa1-7336-4da3-8302-c8bffbced29c tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1557 microversion: 2.1 time: 0.223468 Jul 25 05:41:19.555763 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 231/453] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:19 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1557 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:19.559020 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-11591959-82b5-4068-9c14-a096bcaabc30 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1319 microversion: 2.1 time: 0.211270 Jul 25 05:41:19.559765 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 223/454] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:19 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:19.561129 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c00c38a3-8fea-480f-adba-5d1f824fa404 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:19.561810 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c00c38a3-8fea-480f-adba-5d1f824fa404 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:19.567692 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c00c38a3-8fea-480f-adba-5d1f824fa404 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:19.568148 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c00c38a3-8fea-480f-adba-5d1f824fa404 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:19.568944 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c00c38a3-8fea-480f-adba-5d1f824fa404 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:19.569387 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c00c38a3-8fea-480f-adba-5d1f824fa404 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:19.573681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c5ee1f86-1b1b-4afc-909b-01999955b5b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:19.574193 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c5ee1f86-1b1b-4afc-909b-01999955b5b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:19.580045 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5ee1f86-1b1b-4afc-909b-01999955b5b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:19.580505 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5ee1f86-1b1b-4afc-909b-01999955b5b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:19.581305 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5ee1f86-1b1b-4afc-909b-01999955b5b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:19.581750 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5ee1f86-1b1b-4afc-909b-01999955b5b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:19.686170 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c5ee1f86-1b1b-4afc-909b-01999955b5b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116866 Jul 25 05:41:19.686755 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 224/455] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 25 05:41:19 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:41:19.729978 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-c00c38a3-8fea-480f-adba-5d1f824fa404 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:19.737994 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c00c38a3-8fea-480f-adba-5d1f824fa404 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.181160 Jul 25 05:41:19.738568 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 232/456] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:19 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:20.576224 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5227441f-bb60-406b-b528-b648ac6d2500 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:20.577165 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5227441f-bb60-406b-b528-b648ac6d2500 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:20.583642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5227441f-bb60-406b-b528-b648ac6d2500 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:20.584550 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5227441f-bb60-406b-b528-b648ac6d2500 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:20.584892 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5227441f-bb60-406b-b528-b648ac6d2500 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:20.586109 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5227441f-bb60-406b-b528-b648ac6d2500 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:20.594075 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-48dab322-a16b-4402-99e8-c27922af1f3c req-069831a5-3fdb-47a6-b621-c73fd192c5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdeb60d1-2ee4-4e65-a46e-ae8aa153568c", "name": "network-vif-plugged", "status": "completed", "tag": "be4aadad-fae4-45d9-9f06-a8c23366b5c2"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:20.603228 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-48dab322-a16b-4402-99e8-c27922af1f3c req-069831a5-3fdb-47a6-b621-c73fd192c5b5 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:20.604260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-48dab322-a16b-4402-99e8-c27922af1f3c req-069831a5-3fdb-47a6-b621-c73fd192c5b5 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:20.617652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-48dab322-a16b-4402-99e8-c27922af1f3c req-069831a5-3fdb-47a6-b621-c73fd192c5b5 service nova] Creating event network-vif-plugged:be4aadad-fae4-45d9-9f06-a8c23366b5c2 for instance fdeb60d1-2ee4-4e65-a46e-ae8aa153568c on hv-cinder-85083 Jul 25 05:41:20.625397 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-48dab322-a16b-4402-99e8-c27922af1f3c req-069831a5-3fdb-47a6-b621-c73fd192c5b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035098 Jul 25 05:41:20.626366 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 233/457] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:41:20.751684 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5227441f-bb60-406b-b528-b648ac6d2500 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:20.755774 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ccb2cd42-03dd-4028-8584-83e6652ce568 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:20.756504 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ccb2cd42-03dd-4028-8584-83e6652ce568 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:20.759361 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5227441f-bb60-406b-b528-b648ac6d2500 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1319 microversion: 2.1 time: 0.187613 Jul 25 05:41:20.760986 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 225/458] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:20 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:20.764052 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ccb2cd42-03dd-4028-8584-83e6652ce568 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:20.764505 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ccb2cd42-03dd-4028-8584-83e6652ce568 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:20.765343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ccb2cd42-03dd-4028-8584-83e6652ce568 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:20.765787 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ccb2cd42-03dd-4028-8584-83e6652ce568 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:20.887960 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-a1aae8fd-f652-48a1-8809-c008ad03342e req-a56e09b4-449b-494a-8e1c-9eab3f44f02a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0ce9ee-f993-48f3-81da-8a31b0a2fc21", "tag": "1d7fd591-303f-4f00-9657-b9203d5271ba"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:20.896173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a1aae8fd-f652-48a1-8809-c008ad03342e req-a56e09b4-449b-494a-8e1c-9eab3f44f02a service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:20.896889 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a1aae8fd-f652-48a1-8809-c008ad03342e req-a56e09b4-449b-494a-8e1c-9eab3f44f02a service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:20.899835 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ccb2cd42-03dd-4028-8584-83e6652ce568 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:20.909165 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-a1aae8fd-f652-48a1-8809-c008ad03342e req-a56e09b4-449b-494a-8e1c-9eab3f44f02a service nova] Creating event network-changed:1d7fd591-303f-4f00-9657-b9203d5271ba for instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 on hv-cinder-85083 Jul 25 05:41:20.910170 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ccb2cd42-03dd-4028-8584-83e6652ce568 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.158499 Jul 25 05:41:20.910886 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 234/459] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:20 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:20.914690 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-a1aae8fd-f652-48a1-8809-c008ad03342e req-a56e09b4-449b-494a-8e1c-9eab3f44f02a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031183 Jul 25 05:41:20.917344 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 226/460] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:41:21.778179 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8d76db7b-dd06-49f4-b78c-63525f81ccd6 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:21.779456 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8d76db7b-dd06-49f4-b78c-63525f81ccd6 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:21.781513 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=8 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:21.788081 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8d76db7b-dd06-49f4-b78c-63525f81ccd6 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:21.788829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8d76db7b-dd06-49f4-b78c-63525f81ccd6 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:21.789765 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8d76db7b-dd06-49f4-b78c-63525f81ccd6 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:21.790368 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8d76db7b-dd06-49f4-b78c-63525f81ccd6 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:21.930226 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-23bba181-8158-41c3-9d41-071a814d61cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:21.931584 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-23bba181-8158-41c3-9d41-071a814d61cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:21.943044 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=4 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:21.944567 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=12 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:21.948387 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-23bba181-8158-41c3-9d41-071a814d61cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:21.949320 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-23bba181-8158-41c3-9d41-071a814d61cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:21.950583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-23bba181-8158-41c3-9d41-071a814d61cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:21.951441 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-23bba181-8158-41c3-9d41-071a814d61cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:22.407515 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8d76db7b-dd06-49f4-b78c-63525f81ccd6 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:22.414113 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-23bba181-8158-41c3-9d41-071a814d61cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:22.415683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8d76db7b-dd06-49f4-b78c-63525f81ccd6 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1319 microversion: 2.1 time: 0.642540 Jul 25 05:41:22.417202 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 235/461] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:21 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1319 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:22.423314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-23bba181-8158-41c3-9d41-071a814d61cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.497801 Jul 25 05:41:22.425591 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 227/462] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:21 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:23.433328 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-eaa77276-5234-4999-8b82-d47142d8e474 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:23.433889 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-eaa77276-5234-4999-8b82-d47142d8e474 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:23.441582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eaa77276-5234-4999-8b82-d47142d8e474 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:23.442004 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f5448dba-eb68-40df-8e95-c3f2b01ccd35 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:23.442443 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eaa77276-5234-4999-8b82-d47142d8e474 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:23.442796 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eaa77276-5234-4999-8b82-d47142d8e474 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:23.443160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f5448dba-eb68-40df-8e95-c3f2b01ccd35 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:23.443321 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eaa77276-5234-4999-8b82-d47142d8e474 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:23.451802 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5448dba-eb68-40df-8e95-c3f2b01ccd35 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:23.452254 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5448dba-eb68-40df-8e95-c3f2b01ccd35 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:23.453057 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5448dba-eb68-40df-8e95-c3f2b01ccd35 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:23.453500 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5448dba-eb68-40df-8e95-c3f2b01ccd35 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:23.639759 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-eaa77276-5234-4999-8b82-d47142d8e474 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:23.642647 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f5448dba-eb68-40df-8e95-c3f2b01ccd35 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:23.647335 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-eaa77276-5234-4999-8b82-d47142d8e474 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1319 microversion: 2.1 time: 0.217988 Jul 25 05:41:23.647907 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 236/463] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:23 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:23.651242 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f5448dba-eb68-40df-8e95-c3f2b01ccd35 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1736 microversion: 2.1 time: 0.213964 Jul 25 05:41:23.651981 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 228/464] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:23 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:24.664616 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-23118b00-9d69-420b-8aee-9c68b43548e1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:24.665259 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-23118b00-9d69-420b-8aee-9c68b43548e1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:24.669147 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-77d4e413-24ed-4d23-a6a2-8f43d2dde5a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:24.669842 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-77d4e413-24ed-4d23-a6a2-8f43d2dde5a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:24.672531 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-23118b00-9d69-420b-8aee-9c68b43548e1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:24.673032 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-23118b00-9d69-420b-8aee-9c68b43548e1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:24.673805 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-23118b00-9d69-420b-8aee-9c68b43548e1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:24.674246 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-23118b00-9d69-420b-8aee-9c68b43548e1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:24.676301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77d4e413-24ed-4d23-a6a2-8f43d2dde5a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:24.676757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77d4e413-24ed-4d23-a6a2-8f43d2dde5a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:24.677553 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77d4e413-24ed-4d23-a6a2-8f43d2dde5a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:24.677995 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77d4e413-24ed-4d23-a6a2-8f43d2dde5a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:24.865644 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-23118b00-9d69-420b-8aee-9c68b43548e1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:24.873261 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-23118b00-9d69-420b-8aee-9c68b43548e1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1509 microversion: 2.1 time: 0.212569 Jul 25 05:41:24.873862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 237/465] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:24 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:24.879902 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-77d4e413-24ed-4d23-a6a2-8f43d2dde5a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:24.888510 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-77d4e413-24ed-4d23-a6a2-8f43d2dde5a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1716 microversion: 2.1 time: 0.224026 Jul 25 05:41:24.889094 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 229/466] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:24 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1716 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:24.890256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-0c2c7131-ff36-48f8-b660-5e606d1521a1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "addf0c28-e7d9-4618-b3f0-e125c26f0410", "device": "/dev/sdb"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:24.891869 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-0c2c7131-ff36-48f8-b660-5e606d1521a1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:24.898033 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0c2c7131-ff36-48f8-b660-5e606d1521a1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:24.898489 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0c2c7131-ff36-48f8-b660-5e606d1521a1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:24.899256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0c2c7131-ff36-48f8-b660-5e606d1521a1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:24.899700 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0c2c7131-ff36-48f8-b660-5e606d1521a1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:24.992372 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d4e5d8ec-0cc9-4690-a438-980a21b8d52e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:24.992916 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d4e5d8ec-0cc9-4690-a438-980a21b8d52e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:24.998938 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4e5d8ec-0cc9-4690-a438-980a21b8d52e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:24.999390 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4e5d8ec-0cc9-4690-a438-980a21b8d52e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:25.000152 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4e5d8ec-0cc9-4690-a438-980a21b8d52e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:25.000591 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4e5d8ec-0cc9-4690-a438-980a21b8d52e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:25.127554 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-d4e5d8ec-0cc9-4690-a438-980a21b8d52e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] HTTP exception thrown: Cannot 'detach_volume' instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa while it is in vm_state rescued Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d4e5d8ec-0cc9-4690-a438-980a21b8d52e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Request method failure captured: Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments/27dbbdee-9852-4b6a-86a3-125e386a3519 HTTP/1.1 Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iwGlH116eE9G9ee7Lm8JbUWiAPDu8YN3efd6rqcOJFGqiqIvx-Z4bkyaOgt73L_olv3J7RnJmzhVyekt9wWkZaL54kuiNpYanVEwj12N03q2Ucu7IGSA5oKP8wI9kg26x-Wl7rEFaGGhyw8DEAlUPLkVAIgJLPtlKNbsgMEc5Hn6Y8 Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: c782b01e8e484fe8bb710aeddc0192d1 Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:41:25.129245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:41:25.130648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c782b01e8e484fe8bb710aeddc0192d1"}]}] Jul 25 05:41:25.130648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:41:25.130648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c782b01e8e484fe8bb710aeddc0192d1 Jul 25 05:41:25.130648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:41:25.130648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-ServerRescueNegativeTestJSON-1264352499-project Jul 25 05:41:25.130648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:41:25.130648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:41:25.130648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 37c1bb8500f74013b073febfc0d96217 Jul 25 05:41:25.130648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1264352499-project Jul 25 05:41:25.130648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:41:25.130648 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Cannot 'detach_volume' instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa while it is in vm_state rescued Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'server_id': '6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa', 'id': '27dbbdee-9852-4b6a-86a3-125e386a3519'} Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:41:25.131388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa while it is in vm_state rescued Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa while it is in vm_state rescued Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:41:25.132826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d4e5d8ec-0cc9-4690-a438-980a21b8d52e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Returning 409 to user: Cannot 'detach_volume' instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa while it is in vm_state rescued {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:41:25.133983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d4e5d8ec-0cc9-4690-a438-980a21b8d52e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments/27dbbdee-9852-4b6a-86a3-125e386a3519" status: 409 len: 152 microversion: 2.1 time: 0.142318 Jul 25 05:41:25.133983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 230/467] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:41:24 2022] DELETE /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments/27dbbdee-9852-4b6a-86a3-125e386a3519 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 05:41:25.139308 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-65e31501-7ba1-4bbb-9fd5-580f3993c951 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:25.139833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-65e31501-7ba1-4bbb-9fd5-580f3993c951 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:25.146676 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-65e31501-7ba1-4bbb-9fd5-580f3993c951 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:25.147128 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-65e31501-7ba1-4bbb-9fd5-580f3993c951 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:25.147892 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-65e31501-7ba1-4bbb-9fd5-580f3993c951 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:25.148328 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-65e31501-7ba1-4bbb-9fd5-580f3993c951 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:25.203838 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:25.223285 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-65e31501-7ba1-4bbb-9fd5-580f3993c951 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "POST /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/action" status: 202 len: 0 microversion: 2.1 time: 0.087403 Jul 25 05:41:25.223993 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 231/468] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:41:25 2022] POST /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 05:41:25.233662 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8a96c644-d2e8-47ae-b620-b391c9d4ee6b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:25.234459 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8a96c644-d2e8-47ae-b620-b391c9d4ee6b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:25.241043 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a96c644-d2e8-47ae-b620-b391c9d4ee6b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:25.241550 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a96c644-d2e8-47ae-b620-b391c9d4ee6b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:25.242482 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a96c644-d2e8-47ae-b620-b391c9d4ee6b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:25.242841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a96c644-d2e8-47ae-b620-b391c9d4ee6b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:25.333021 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-0c2c7131-ff36-48f8-b660-5e606d1521a1 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "POST /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446493 Jul 25 05:41:25.333925 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 238/469] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:41:24 2022] POST /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c/os-volume_attachments => generated 194 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:41:25.566717 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8a96c644-d2e8-47ae-b620-b391c9d4ee6b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:25.576282 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8a96c644-d2e8-47ae-b620-b391c9d4ee6b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1724 microversion: 2.1 time: 0.347776 Jul 25 05:41:25.576870 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 232/470] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:25 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:26.594930 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-40d179ff-a7c7-40c6-b2fb-e1b27dbbb261 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:26.595622 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-40d179ff-a7c7-40c6-b2fb-e1b27dbbb261 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:26.601796 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-40d179ff-a7c7-40c6-b2fb-e1b27dbbb261 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:26.602245 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-40d179ff-a7c7-40c6-b2fb-e1b27dbbb261 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:26.602996 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-40d179ff-a7c7-40c6-b2fb-e1b27dbbb261 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:26.603429 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-40d179ff-a7c7-40c6-b2fb-e1b27dbbb261 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:26.738501 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-40d179ff-a7c7-40c6-b2fb-e1b27dbbb261 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:26.747525 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-40d179ff-a7c7-40c6-b2fb-e1b27dbbb261 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1724 microversion: 2.1 time: 0.157299 Jul 25 05:41:26.748089 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 239/471] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:26 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:27.765040 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f70625cb-e42a-40f7-9b53-43e35f69d6c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:27.765686 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f70625cb-e42a-40f7-9b53-43e35f69d6c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:27.772098 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f70625cb-e42a-40f7-9b53-43e35f69d6c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:27.772552 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f70625cb-e42a-40f7-9b53-43e35f69d6c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:27.773353 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f70625cb-e42a-40f7-9b53-43e35f69d6c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:27.773797 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f70625cb-e42a-40f7-9b53-43e35f69d6c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:27.899938 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f70625cb-e42a-40f7-9b53-43e35f69d6c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:27.908471 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f70625cb-e42a-40f7-9b53-43e35f69d6c3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1724 microversion: 2.1 time: 0.147345 Jul 25 05:41:27.909049 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 233/472] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:27 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:41:28.925559 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8b059b35-3b5a-4fec-bbf5-d32964adb980 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:28.926196 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8b059b35-3b5a-4fec-bbf5-d32964adb980 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:28.932801 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b059b35-3b5a-4fec-bbf5-d32964adb980 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:28.933285 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b059b35-3b5a-4fec-bbf5-d32964adb980 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:28.934619 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b059b35-3b5a-4fec-bbf5-d32964adb980 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:28.935238 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b059b35-3b5a-4fec-bbf5-d32964adb980 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:29.065920 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8b059b35-3b5a-4fec-bbf5-d32964adb980 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:29.073883 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8b059b35-3b5a-4fec-bbf5-d32964adb980 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1730 microversion: 2.1 time: 0.152207 Jul 25 05:41:29.074445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 240/473] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:28 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:29.090896 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-486925dc-6c22-4f4b-a2dd-8a5d0f87bccb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:29.091453 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-486925dc-6c22-4f4b-a2dd-8a5d0f87bccb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:29.097885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-486925dc-6c22-4f4b-a2dd-8a5d0f87bccb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:29.098371 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-486925dc-6c22-4f4b-a2dd-8a5d0f87bccb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:29.099143 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-486925dc-6c22-4f4b-a2dd-8a5d0f87bccb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:29.099587 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-486925dc-6c22-4f4b-a2dd-8a5d0f87bccb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:29.176330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-486925dc-6c22-4f4b-a2dd-8a5d0f87bccb tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090109 Jul 25 05:41:29.176969 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 234/474] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 25 05:41:29 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:41:30.063487 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-8d3bb0f0-dc2c-4785-9051-fa12349f088a req-3bb15e1e-c9f4-4778-a9ad-0f4703a2f9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa", "tag": "db49e6cc-810b-4a89-a2fb-e0718b506f4b"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:30.071981 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-8d3bb0f0-dc2c-4785-9051-fa12349f088a req-3bb15e1e-c9f4-4778-a9ad-0f4703a2f9c2 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:30.072630 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-8d3bb0f0-dc2c-4785-9051-fa12349f088a req-3bb15e1e-c9f4-4778-a9ad-0f4703a2f9c2 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:30.084047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-8d3bb0f0-dc2c-4785-9051-fa12349f088a req-3bb15e1e-c9f4-4778-a9ad-0f4703a2f9c2 service nova] Creating event network-changed:db49e6cc-810b-4a89-a2fb-e0718b506f4b for instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa on hv-cinder-85083 Jul 25 05:41:30.089986 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-8d3bb0f0-dc2c-4785-9051-fa12349f088a req-3bb15e1e-c9f4-4778-a9ad-0f4703a2f9c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030368 Jul 25 05:41:30.090584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 241/475] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:41:32.104904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-ffaa6dba-3fc9-4ce6-a5ff-9f38f5306923 req-d84d30e3-c068-4b9c-81ae-785ae24d1fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa", "tag": "db49e6cc-810b-4a89-a2fb-e0718b506f4b"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:32.112771 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ffaa6dba-3fc9-4ce6-a5ff-9f38f5306923 req-d84d30e3-c068-4b9c-81ae-785ae24d1fe3 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:32.113236 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ffaa6dba-3fc9-4ce6-a5ff-9f38f5306923 req-d84d30e3-c068-4b9c-81ae-785ae24d1fe3 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:32.124596 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-ffaa6dba-3fc9-4ce6-a5ff-9f38f5306923 req-d84d30e3-c068-4b9c-81ae-785ae24d1fe3 service nova] Creating event network-changed:db49e6cc-810b-4a89-a2fb-e0718b506f4b for instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa on hv-cinder-85083 Jul 25 05:41:32.129518 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-ffaa6dba-3fc9-4ce6-a5ff-9f38f5306923 req-d84d30e3-c068-4b9c-81ae-785ae24d1fe3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029003 Jul 25 05:41:32.130074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 235/476] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:41:36.298378 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3c02bf3a-b2d9-4d8f-87da-c2f6c70fe07b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:36.298955 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3c02bf3a-b2d9-4d8f-87da-c2f6c70fe07b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:36.305115 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3c02bf3a-b2d9-4d8f-87da-c2f6c70fe07b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:36.305564 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3c02bf3a-b2d9-4d8f-87da-c2f6c70fe07b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:36.306319 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3c02bf3a-b2d9-4d8f-87da-c2f6c70fe07b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:36.306756 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3c02bf3a-b2d9-4d8f-87da-c2f6c70fe07b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:36.386518 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-3c02bf3a-b2d9-4d8f-87da-c2f6c70fe07b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lazy-loading 'services' on Instance uuid 4943e050-a915-4850-8e01-9590c5fcde77 {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:41:36.457573 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3c02bf3a-b2d9-4d8f-87da-c2f6c70fe07b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/os-volume_attachments/75d3e840-7ab9-4fc3-8f9c-7974aaf63d51" status: 202 len: 0 microversion: 2.1 time: 0.163966 Jul 25 05:41:36.458156 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 242/477] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:41:36 2022] DELETE /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/os-volume_attachments/75d3e840-7ab9-4fc3-8f9c-7974aaf63d51 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:41:41.781304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2e6bd807-827c-43a8-b611-37bf73acfb6c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:41.783291 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:41.788631 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2e6bd807-827c-43a8-b611-37bf73acfb6c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:41.789111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2e6bd807-827c-43a8-b611-37bf73acfb6c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:41.812359 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2e6bd807-827c-43a8-b611-37bf73acfb6c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Going to try to stop instance {{(pid=124466) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 05:41:41.852657 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2e6bd807-827c-43a8-b611-37bf73acfb6c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "POST /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/action" status: 202 len: 0 microversion: 2.1 time: 0.076427 Jul 25 05:41:41.853292 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 236/478] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:41:41 2022] POST /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:41:41.863048 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-90448105-0013-4c99-a763-fa4c86fa2198 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:41.863737 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-90448105-0013-4c99-a763-fa4c86fa2198 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:41.865707 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=58 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:41.871350 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90448105-0013-4c99-a763-fa4c86fa2198 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:41.871806 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90448105-0013-4c99-a763-fa4c86fa2198 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:41.872579 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90448105-0013-4c99-a763-fa4c86fa2198 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:41.873046 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90448105-0013-4c99-a763-fa4c86fa2198 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:42.005511 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-90448105-0013-4c99-a763-fa4c86fa2198 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:42.013361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-90448105-0013-4c99-a763-fa4c86fa2198 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1678 microversion: 2.1 time: 0.155046 Jul 25 05:41:42.013954 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 243/479] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:41 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:43.031829 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-67fbd095-7297-4903-9db1-44ca1d228602 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:43.032562 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-67fbd095-7297-4903-9db1-44ca1d228602 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:43.038785 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-67fbd095-7297-4903-9db1-44ca1d228602 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:43.039244 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-67fbd095-7297-4903-9db1-44ca1d228602 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:43.040014 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-67fbd095-7297-4903-9db1-44ca1d228602 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:43.040459 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-67fbd095-7297-4903-9db1-44ca1d228602 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:43.171698 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-67fbd095-7297-4903-9db1-44ca1d228602 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:43.180166 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-67fbd095-7297-4903-9db1-44ca1d228602 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1678 microversion: 2.1 time: 0.153278 Jul 25 05:41:43.180739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 237/480] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:43 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:44.198333 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2a612d9c-d1af-4317-9ce8-85d030990b56 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:44.198945 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2a612d9c-d1af-4317-9ce8-85d030990b56 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:44.206328 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2a612d9c-d1af-4317-9ce8-85d030990b56 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:44.206789 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2a612d9c-d1af-4317-9ce8-85d030990b56 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:44.207555 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2a612d9c-d1af-4317-9ce8-85d030990b56 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:44.208001 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2a612d9c-d1af-4317-9ce8-85d030990b56 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:44.334424 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2a612d9c-d1af-4317-9ce8-85d030990b56 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:44.342228 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2a612d9c-d1af-4317-9ce8-85d030990b56 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1678 microversion: 2.1 time: 0.147748 Jul 25 05:41:44.342788 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 244/481] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:44 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:44.645170 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4e260066-5547-4248-b0f2-f20fbf36785b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:44.645653 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4e260066-5547-4248-b0f2-f20fbf36785b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:44.652024 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4e260066-5547-4248-b0f2-f20fbf36785b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:44.652474 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4e260066-5547-4248-b0f2-f20fbf36785b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:44.653381 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4e260066-5547-4248-b0f2-f20fbf36785b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:44.653828 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4e260066-5547-4248-b0f2-f20fbf36785b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:44.737480 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-4e260066-5547-4248-b0f2-f20fbf36785b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lazy-loading 'services' on Instance uuid fdeb60d1-2ee4-4e65-a46e-ae8aa153568c {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:41:44.739455 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:44.850096 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4e260066-5547-4248-b0f2-f20fbf36785b tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c/os-volume_attachments/addf0c28-e7d9-4618-b3f0-e125c26f0410" status: 202 len: 0 microversion: 2.1 time: 0.208641 Jul 25 05:41:44.850675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 238/482] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:41:44 2022] DELETE /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c/os-volume_attachments/addf0c28-e7d9-4618-b3f0-e125c26f0410 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:41:45.359545 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-be55dffa-d590-4bab-8101-4bd242666995 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:45.360225 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-be55dffa-d590-4bab-8101-4bd242666995 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:45.366667 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-be55dffa-d590-4bab-8101-4bd242666995 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:45.367117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-be55dffa-d590-4bab-8101-4bd242666995 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:45.367866 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-be55dffa-d590-4bab-8101-4bd242666995 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:45.368307 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-be55dffa-d590-4bab-8101-4bd242666995 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:45.505179 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-be55dffa-d590-4bab-8101-4bd242666995 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:45.513004 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-be55dffa-d590-4bab-8101-4bd242666995 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1678 microversion: 2.1 time: 0.157548 Jul 25 05:41:45.513841 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 245/483] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:45 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:45.969193 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-70112ef8-5447-405c-8408-b031f03bec5c tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:45.969786 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-70112ef8-5447-405c-8408-b031f03bec5c tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:45.975911 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-70112ef8-5447-405c-8408-b031f03bec5c tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:45.976364 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-70112ef8-5447-405c-8408-b031f03bec5c tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:45.977162 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-70112ef8-5447-405c-8408-b031f03bec5c tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:45.977609 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-70112ef8-5447-405c-8408-b031f03bec5c tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:46.001949 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-70112ef8-5447-405c-8408-b031f03bec5c tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:41:46.074771 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-70112ef8-5447-405c-8408-b031f03bec5c tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 204 len: 0 microversion: 2.1 time: 0.110984 Jul 25 05:41:46.076506 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 239/484] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:41:45 2022] DELETE /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:41:46.085064 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-51ff3141-c9f7-4c67-9ed5-cb5bbc1d9192 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:46.085792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-51ff3141-c9f7-4c67-9ed5-cb5bbc1d9192 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:46.092749 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-51ff3141-c9f7-4c67-9ed5-cb5bbc1d9192 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:46.093286 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-51ff3141-c9f7-4c67-9ed5-cb5bbc1d9192 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:46.094044 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-51ff3141-c9f7-4c67-9ed5-cb5bbc1d9192 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:46.094478 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-51ff3141-c9f7-4c67-9ed5-cb5bbc1d9192 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:46.223150 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-51ff3141-c9f7-4c67-9ed5-cb5bbc1d9192 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:46.230525 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-51ff3141-c9f7-4c67-9ed5-cb5bbc1d9192 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1515 microversion: 2.1 time: 0.149625 Jul 25 05:41:46.231081 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 246/485] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:46 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:46.531118 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c7e7ea58-0908-44f5-a6cd-32097c5d3b65 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:46.531887 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c7e7ea58-0908-44f5-a6cd-32097c5d3b65 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:46.537825 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c7e7ea58-0908-44f5-a6cd-32097c5d3b65 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:46.538276 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c7e7ea58-0908-44f5-a6cd-32097c5d3b65 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:46.539033 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c7e7ea58-0908-44f5-a6cd-32097c5d3b65 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:46.539474 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c7e7ea58-0908-44f5-a6cd-32097c5d3b65 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:46.671864 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c7e7ea58-0908-44f5-a6cd-32097c5d3b65 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:46.679207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c7e7ea58-0908-44f5-a6cd-32097c5d3b65 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1678 microversion: 2.1 time: 0.152934 Jul 25 05:41:46.679767 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 240/486] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:46 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:47.248208 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-bbc2793d-8ead-4a73-bc49-3855a7227eb0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:47.248755 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-bbc2793d-8ead-4a73-bc49-3855a7227eb0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:47.255260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bbc2793d-8ead-4a73-bc49-3855a7227eb0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:47.255703 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bbc2793d-8ead-4a73-bc49-3855a7227eb0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:47.256452 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bbc2793d-8ead-4a73-bc49-3855a7227eb0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:47.256915 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bbc2793d-8ead-4a73-bc49-3855a7227eb0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:47.385506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-bbc2793d-8ead-4a73-bc49-3855a7227eb0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:47.392906 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-bbc2793d-8ead-4a73-bc49-3855a7227eb0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1515 microversion: 2.1 time: 0.149338 Jul 25 05:41:47.393469 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 247/487] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:47 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:47.696536 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-460e077d-e56f-4afd-b266-00c3e7b88c8d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:47.697193 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-460e077d-e56f-4afd-b266-00c3e7b88c8d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:47.703635 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-460e077d-e56f-4afd-b266-00c3e7b88c8d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:47.704237 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-460e077d-e56f-4afd-b266-00c3e7b88c8d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:47.705045 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-460e077d-e56f-4afd-b266-00c3e7b88c8d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:47.705483 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-460e077d-e56f-4afd-b266-00c3e7b88c8d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:47.834159 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-460e077d-e56f-4afd-b266-00c3e7b88c8d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:47.842749 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-460e077d-e56f-4afd-b266-00c3e7b88c8d tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1678 microversion: 2.1 time: 0.150009 Jul 25 05:41:47.843326 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 241/488] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:47 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:48.410331 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f0639873-8e15-46cf-be7f-c73c16928911 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:48.411034 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f0639873-8e15-46cf-be7f-c73c16928911 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:48.417618 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f0639873-8e15-46cf-be7f-c73c16928911 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:48.420079 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f0639873-8e15-46cf-be7f-c73c16928911 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:48.420976 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f0639873-8e15-46cf-be7f-c73c16928911 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:48.421696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f0639873-8e15-46cf-be7f-c73c16928911 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:48.468610 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-682352ab-4378-4bf5-a3f0-9ae3b0be3db2 req-db5db06e-d8e4-4628-9979-f38e15ee7113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdeb60d1-2ee4-4e65-a46e-ae8aa153568c", "name": "network-vif-deleted", "tag": "be4aadad-fae4-45d9-9f06-a8c23366b5c2"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:48.477355 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-682352ab-4378-4bf5-a3f0-9ae3b0be3db2 req-db5db06e-d8e4-4628-9979-f38e15ee7113 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:48.477802 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-682352ab-4378-4bf5-a3f0-9ae3b0be3db2 req-db5db06e-d8e4-4628-9979-f38e15ee7113 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:48.491377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-682352ab-4378-4bf5-a3f0-9ae3b0be3db2 req-db5db06e-d8e4-4628-9979-f38e15ee7113 service nova] Creating event network-vif-deleted:be4aadad-fae4-45d9-9f06-a8c23366b5c2 for instance fdeb60d1-2ee4-4e65-a46e-ae8aa153568c on hv-cinder-85083 Jul 25 05:41:48.496851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-682352ab-4378-4bf5-a3f0-9ae3b0be3db2 req-db5db06e-d8e4-4628-9979-f38e15ee7113 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032439 Jul 25 05:41:48.497605 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 242/489] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:41:48.498719 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f0639873-8e15-46cf-be7f-c73c16928911 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0944d760224239bd16aa0981db0eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213b3114e35d4016b3169364760edb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:48.506975 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f0639873-8e15-46cf-be7f-c73c16928911 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 200 len: 1473 microversion: 2.1 time: 0.100574 Jul 25 05:41:48.507550 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 248/490] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:48 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 1473 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:48.861148 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c8b4871c-02cc-4e7c-bdfe-0cbd80b202c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:48.861851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c8b4871c-02cc-4e7c-bdfe-0cbd80b202c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:48.868195 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8b4871c-02cc-4e7c-bdfe-0cbd80b202c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:48.868682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8b4871c-02cc-4e7c-bdfe-0cbd80b202c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:48.869501 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8b4871c-02cc-4e7c-bdfe-0cbd80b202c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:48.869935 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8b4871c-02cc-4e7c-bdfe-0cbd80b202c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:49.011114 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c8b4871c-02cc-4e7c-bdfe-0cbd80b202c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:49.019151 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c8b4871c-02cc-4e7c-bdfe-0cbd80b202c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1678 microversion: 2.1 time: 0.162753 Jul 25 05:41:49.019811 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 243/491] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:48 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:49.523677 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-319f888c-c6fc-48e7-87da-f50117b4fea0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:49.524292 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-319f888c-c6fc-48e7-87da-f50117b4fea0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] [instance: fdeb60d1-2ee4-4e65-a46e-ae8aa153568c] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:49.531062 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-319f888c-c6fc-48e7-87da-f50117b4fea0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:49.531515 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-319f888c-c6fc-48e7-87da-f50117b4fea0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:49.532274 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-319f888c-c6fc-48e7-87da-f50117b4fea0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:49.532712 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-319f888c-c6fc-48e7-87da-f50117b4fea0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:49.546817 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-319f888c-c6fc-48e7-87da-f50117b4fea0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] HTTP exception thrown: Instance fdeb60d1-2ee4-4e65-a46e-ae8aa153568c could not be found. Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-319f888c-c6fc-48e7-87da-f50117b4fea0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Request method failure captured: Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c HTTP/1.1 Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iyJL2Zbz0Bdze70DEvJJEbsn363JEYG3m7pZz1BSV7ypZ13ix9GQj6Hn1IJFwktmPrXzYdzn9-OV4B6ns5yltL3O0mnf4nJ5uNji1KHCblauy7OfnKFqtmGkKs9nr-OYpMldsC4abfsnU0DW58YuUMeQnE7ZWti98PoGORrXWYON5g Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 213b3114e35d4016b3169364760edb17 Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1963100190 Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:41:49.548422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/213b3114e35d4016b3169364760edb17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/213b3114e35d4016b3169364760edb17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/213b3114e35d4016b3169364760edb17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_213b3114e35d4016b3169364760edb17"}]}] Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-VolumesSnapshotTestJSON-1963100190 Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 213b3114e35d4016b3169364760edb17 Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1963100190 Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-VolumesSnapshotTestJSON-1963100190-project Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: ce0944d760224239bd16aa0981db0eec Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-VolumesSnapshotTestJSON-1963100190-project Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance fdeb60d1-2ee4-4e65-a46e-ae8aa153568c could not be found. Jul 25 05:41:49.550116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': 'fdeb60d1-2ee4-4e65-a46e-ae8aa153568c'} Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdeb60d1-2ee4-4e65-a46e-ae8aa153568c could not be found. Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:41:49.550958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdeb60d1-2ee4-4e65-a46e-ae8aa153568c could not be found. Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdeb60d1-2ee4-4e65-a46e-ae8aa153568c could not be found. Jul 25 05:41:49.552431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:41:49.553685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-319f888c-c6fc-48e7-87da-f50117b4fea0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] Returning 404 to user: Instance fdeb60d1-2ee4-4e65-a46e-ae8aa153568c could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:41:49.553685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-319f888c-c6fc-48e7-87da-f50117b4fea0 tempest-VolumesSnapshotTestJSON-1963100190 tempest-VolumesSnapshotTestJSON-1963100190-project] 10.222.0.33 "GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c" status: 404 len: 111 microversion: 2.1 time: 0.029986 Jul 25 05:41:49.553685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 249/492] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:49 2022] GET /compute/v2.1/servers/fdeb60d1-2ee4-4e65-a46e-ae8aa153568c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:41:50.035660 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d4cd9911-6389-4479-81ab-8cf51f956a06 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:50.036231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d4cd9911-6389-4479-81ab-8cf51f956a06 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:50.042510 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4cd9911-6389-4479-81ab-8cf51f956a06 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:50.042961 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4cd9911-6389-4479-81ab-8cf51f956a06 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:50.043720 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4cd9911-6389-4479-81ab-8cf51f956a06 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:50.044215 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4cd9911-6389-4479-81ab-8cf51f956a06 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:50.177996 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d4cd9911-6389-4479-81ab-8cf51f956a06 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:50.185731 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d4cd9911-6389-4479-81ab-8cf51f956a06 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1678 microversion: 2.1 time: 0.153929 Jul 25 05:41:50.186408 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 244/493] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:50 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:51.203859 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4cf3fa8d-14c9-4263-9e65-b1c797307fa7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:51.204391 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4cf3fa8d-14c9-4263-9e65-b1c797307fa7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:51.210900 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cf3fa8d-14c9-4263-9e65-b1c797307fa7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:51.211365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cf3fa8d-14c9-4263-9e65-b1c797307fa7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:51.212132 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cf3fa8d-14c9-4263-9e65-b1c797307fa7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:51.212578 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cf3fa8d-14c9-4263-9e65-b1c797307fa7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:51.344648 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4cf3fa8d-14c9-4263-9e65-b1c797307fa7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:51.352064 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4cf3fa8d-14c9-4263-9e65-b1c797307fa7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1678 microversion: 2.1 time: 0.152834 Jul 25 05:41:51.352621 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 250/494] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:51 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:52.370104 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6551dbb2-ee7b-40c7-8f39-bbaa0f2230cb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:52.370751 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6551dbb2-ee7b-40c7-8f39-bbaa0f2230cb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:52.377441 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6551dbb2-ee7b-40c7-8f39-bbaa0f2230cb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:52.377898 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6551dbb2-ee7b-40c7-8f39-bbaa0f2230cb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:52.378655 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6551dbb2-ee7b-40c7-8f39-bbaa0f2230cb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:52.379094 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6551dbb2-ee7b-40c7-8f39-bbaa0f2230cb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:52.507957 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6551dbb2-ee7b-40c7-8f39-bbaa0f2230cb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:52.516702 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6551dbb2-ee7b-40c7-8f39-bbaa0f2230cb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1678 microversion: 2.1 time: 0.150415 Jul 25 05:41:52.517340 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 245/495] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:52 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:53.533772 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2ef5669a-2dc3-418e-a1fb-938cba04451c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:53.534322 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2ef5669a-2dc3-418e-a1fb-938cba04451c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:53.540962 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2ef5669a-2dc3-418e-a1fb-938cba04451c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:53.541411 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2ef5669a-2dc3-418e-a1fb-938cba04451c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:53.542184 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2ef5669a-2dc3-418e-a1fb-938cba04451c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:53.542628 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2ef5669a-2dc3-418e-a1fb-938cba04451c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:53.670824 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2ef5669a-2dc3-418e-a1fb-938cba04451c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:53.678184 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2ef5669a-2dc3-418e-a1fb-938cba04451c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1678 microversion: 2.1 time: 0.148302 Jul 25 05:41:53.678744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 251/496] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:53 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:54.695849 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a0b3d9eb-7063-436a-9114-09f61b6940c4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:54.696465 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a0b3d9eb-7063-436a-9114-09f61b6940c4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:54.702761 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0b3d9eb-7063-436a-9114-09f61b6940c4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:54.703215 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0b3d9eb-7063-436a-9114-09f61b6940c4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:54.703982 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0b3d9eb-7063-436a-9114-09f61b6940c4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:54.704427 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0b3d9eb-7063-436a-9114-09f61b6940c4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:54.838412 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a0b3d9eb-7063-436a-9114-09f61b6940c4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:54.846862 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a0b3d9eb-7063-436a-9114-09f61b6940c4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1655 microversion: 2.1 time: 0.155033 Jul 25 05:41:54.847427 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 246/497] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:54 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:54.864991 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-bfe4464b-3d73-45c7-aa7f-1430865013c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:41:54.871509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bfe4464b-3d73-45c7-aa7f-1430865013c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:54.871957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bfe4464b-3d73-45c7-aa7f-1430865013c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:54.893575 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-bfe4464b-3d73-45c7-aa7f-1430865013c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Going to try to start instance {{(pid=124467) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 05:41:54.935883 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-bfe4464b-3d73-45c7-aa7f-1430865013c3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "POST /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/action" status: 202 len: 0 microversion: 2.1 time: 0.074584 Jul 25 05:41:54.936627 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 252/498] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:41:54 2022] POST /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:41:54.945699 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ebe83c14-be72-4184-b9b7-b1f325a26816 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:54.946329 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ebe83c14-be72-4184-b9b7-b1f325a26816 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:54.954396 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebe83c14-be72-4184-b9b7-b1f325a26816 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:54.954976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebe83c14-be72-4184-b9b7-b1f325a26816 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:54.955744 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebe83c14-be72-4184-b9b7-b1f325a26816 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:54.956189 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebe83c14-be72-4184-b9b7-b1f325a26816 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:55.100767 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ebe83c14-be72-4184-b9b7-b1f325a26816 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:55.108588 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ebe83c14-be72-4184-b9b7-b1f325a26816 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1664 microversion: 2.1 time: 0.167054 Jul 25 05:41:55.109196 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 247/499] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:54 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:56.127338 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a3a70cb6-4694-4eae-914b-7048d6bb8328 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:56.127961 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a3a70cb6-4694-4eae-914b-7048d6bb8328 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:56.134202 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a3a70cb6-4694-4eae-914b-7048d6bb8328 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:56.134652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a3a70cb6-4694-4eae-914b-7048d6bb8328 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:56.135415 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a3a70cb6-4694-4eae-914b-7048d6bb8328 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:56.135853 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a3a70cb6-4694-4eae-914b-7048d6bb8328 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:56.139008 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:56.267779 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a3a70cb6-4694-4eae-914b-7048d6bb8328 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:56.275233 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a3a70cb6-4694-4eae-914b-7048d6bb8328 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1664 microversion: 2.1 time: 0.152909 Jul 25 05:41:56.275799 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 253/500] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:56 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:41:57.292995 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e95dd22f-e5b1-481d-ae1b-e734ad582623 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:41:57.293606 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e95dd22f-e5b1-481d-ae1b-e734ad582623 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:41:57.300123 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e95dd22f-e5b1-481d-ae1b-e734ad582623 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:57.300581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e95dd22f-e5b1-481d-ae1b-e734ad582623 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:57.301369 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e95dd22f-e5b1-481d-ae1b-e734ad582623 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:41:57.301813 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e95dd22f-e5b1-481d-ae1b-e734ad582623 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:41:57.438971 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e95dd22f-e5b1-481d-ae1b-e734ad582623 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:41:57.446528 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e95dd22f-e5b1-481d-ae1b-e734ad582623 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1668 microversion: 2.1 time: 0.157379 Jul 25 05:41:57.447125 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 248/501] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:41:57 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:04.731520 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-09b5b132-84a4-4c24-86dc-36c9a00d2ca6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:04.732091 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-09b5b132-84a4-4c24-86dc-36c9a00d2ca6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:04.739256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-09b5b132-84a4-4c24-86dc-36c9a00d2ca6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:04.739715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-09b5b132-84a4-4c24-86dc-36c9a00d2ca6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:04.740498 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-09b5b132-84a4-4c24-86dc-36c9a00d2ca6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:04.741086 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-09b5b132-84a4-4c24-86dc-36c9a00d2ca6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:04.776671 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-09b5b132-84a4-4c24-86dc-36c9a00d2ca6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/ips" status: 200 len: 150 microversion: 2.1 time: 0.049166 Jul 25 05:42:04.777277 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 254/502] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 25 05:42:04 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:06.098389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c10f59e7-94ae-4e24-8574-acc976270344 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96a1e542-486e-42d1-8f73-7f753ad6bc62"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:06.099452 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c10f59e7-94ae-4e24-8574-acc976270344 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:06.106032 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c10f59e7-94ae-4e24-8574-acc976270344 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:06.106491 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c10f59e7-94ae-4e24-8574-acc976270344 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:06.107254 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c10f59e7-94ae-4e24-8574-acc976270344 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:06.108319 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c10f59e7-94ae-4e24-8574-acc976270344 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:06.528554 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c10f59e7-94ae-4e24-8574-acc976270344 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433822 Jul 25 05:42:06.529207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 249/503] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:42:06 2022] POST /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:42:11.005535 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a8a6312e-db8e-4624-a67e-903d0695f1f2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:11.006071 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a8a6312e-db8e-4624-a67e-903d0695f1f2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:11.012077 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a8a6312e-db8e-4624-a67e-903d0695f1f2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:11.012532 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a8a6312e-db8e-4624-a67e-903d0695f1f2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:11.013312 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a8a6312e-db8e-4624-a67e-903d0695f1f2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:11.013755 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a8a6312e-db8e-4624-a67e-903d0695f1f2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:11.139917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-a8a6312e-db8e-4624-a67e-903d0695f1f2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lazy-loading 'services' on Instance uuid 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:42:11.213023 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a8a6312e-db8e-4624-a67e-903d0695f1f2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments/27dbbdee-9852-4b6a-86a3-125e386a3519" status: 202 len: 0 microversion: 2.1 time: 0.211353 Jul 25 05:42:11.213786 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 255/504] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:42:11 2022] DELETE /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments/27dbbdee-9852-4b6a-86a3-125e386a3519 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:42:11.224261 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-df9a37f1-5689-48c1-a5af-e477bcb8a74e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:11.225411 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-df9a37f1-5689-48c1-a5af-e477bcb8a74e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:11.232062 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df9a37f1-5689-48c1-a5af-e477bcb8a74e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:11.232526 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df9a37f1-5689-48c1-a5af-e477bcb8a74e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:11.233436 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df9a37f1-5689-48c1-a5af-e477bcb8a74e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:11.233890 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df9a37f1-5689-48c1-a5af-e477bcb8a74e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:11.263011 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-df9a37f1-5689-48c1-a5af-e477bcb8a74e tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044145 Jul 25 05:42:11.263474 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 250/505] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:42:11 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:42:12.275012 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-43b0db27-9126-4d20-8643-a11108907df2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:12.276075 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-43b0db27-9126-4d20-8643-a11108907df2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:12.279972 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=26 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:12.284707 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-43b0db27-9126-4d20-8643-a11108907df2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:12.285181 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-43b0db27-9126-4d20-8643-a11108907df2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:12.286323 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-43b0db27-9126-4d20-8643-a11108907df2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:12.286933 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-43b0db27-9126-4d20-8643-a11108907df2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:12.318596 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-43b0db27-9126-4d20-8643-a11108907df2 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047773 Jul 25 05:42:12.319149 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 256/506] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:42:12 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:13.331048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5bad732c-b8d6-46b6-bc01-b2b62ecf45e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:13.332008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5bad732c-b8d6-46b6-bc01-b2b62ecf45e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:13.334469 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:13.339712 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5bad732c-b8d6-46b6-bc01-b2b62ecf45e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:13.340269 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5bad732c-b8d6-46b6-bc01-b2b62ecf45e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:13.341394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5bad732c-b8d6-46b6-bc01-b2b62ecf45e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:13.341855 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5bad732c-b8d6-46b6-bc01-b2b62ecf45e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:13.375720 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5bad732c-b8d6-46b6-bc01-b2b62ecf45e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049264 Jul 25 05:42:13.376656 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 251/507] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:42:13 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:14.070950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4153aca5-26fe-4726-a49a-db53407dc861 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96a1e542-486e-42d1-8f73-7f753ad6bc62"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:14.073059 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4153aca5-26fe-4726-a49a-db53407dc861 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:14.079591 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4153aca5-26fe-4726-a49a-db53407dc861 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:14.080179 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4153aca5-26fe-4726-a49a-db53407dc861 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:14.081088 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4153aca5-26fe-4726-a49a-db53407dc861 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:14.081642 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4153aca5-26fe-4726-a49a-db53407dc861 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:14.200958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-4153aca5-26fe-4726-a49a-db53407dc861 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Invalid volume: volume 96a1e542-486e-42d1-8f73-7f753ad6bc62 is already attached to instances: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4153aca5-26fe-4726-a49a-db53407dc861 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: POST /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-volume_attachments HTTP/1.1 Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 74 Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:42:14.202943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {"volumeAttachment": {"volumeId": "96a1e542-486e-42d1-8f73-7f753ad6bc62"}} Jul 25 05:42:14.204666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Invalid volume: volume 96a1e542-486e-42d1-8f73-7f753ad6bc62 is already attached to instances: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'server_id': 'fb0ce9ee-f993-48f3-81da-8a31b0a2fc21', 'body': {'volumeAttachment': {'volumeId': '96a1e542-486e-42d1-8f73-7f753ad6bc62'}}} Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 96a1e542-486e-42d1-8f73-7f753ad6bc62 is already attached to instances: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:14.207365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 96a1e542-486e-42d1-8f73-7f753ad6bc62 is already attached to instances: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:14.208829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:14.211416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:14.211416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:42:14.211416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:42:14.211416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 96a1e542-486e-42d1-8f73-7f753ad6bc62 is already attached to instances: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 Jul 25 05:42:14.211416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:14.211416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4153aca5-26fe-4726-a49a-db53407dc861 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 400 to user: Invalid volume: volume 96a1e542-486e-42d1-8f73-7f753ad6bc62 is already attached to instances: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:42:14.211416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4153aca5-26fe-4726-a49a-db53407dc861 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.138294 Jul 25 05:42:14.211416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 257/508] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:42:14 2022] POST /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-volume_attachments => generated 174 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 05:42:14.292011 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4b70cbdf-68b8-445c-b767-7ac70f25ef9a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:14.293158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4b70cbdf-68b8-445c-b767-7ac70f25ef9a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:14.300847 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b70cbdf-68b8-445c-b767-7ac70f25ef9a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:14.301568 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b70cbdf-68b8-445c-b767-7ac70f25ef9a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:14.302445 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b70cbdf-68b8-445c-b767-7ac70f25ef9a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:14.303243 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b70cbdf-68b8-445c-b767-7ac70f25ef9a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:14.391523 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-246aedd1-d3c3-47a9-b2ee-d41cbc22278b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:14.393204 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-246aedd1-d3c3-47a9-b2ee-d41cbc22278b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:14.404505 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-246aedd1-d3c3-47a9-b2ee-d41cbc22278b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:14.405445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-246aedd1-d3c3-47a9-b2ee-d41cbc22278b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:14.408717 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-246aedd1-d3c3-47a9-b2ee-d41cbc22278b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:14.409927 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-246aedd1-d3c3-47a9-b2ee-d41cbc22278b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:14.435889 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:14.454560 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-4b70cbdf-68b8-445c-b767-7ac70f25ef9a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lazy-loading 'services' on Instance uuid fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:42:14.479084 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-246aedd1-d3c3-47a9-b2ee-d41cbc22278b tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094493 Jul 25 05:42:14.480333 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 258/509] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:42:14 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:42:14.573188 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4b70cbdf-68b8-445c-b767-7ac70f25ef9a tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-volume_attachments/96a1e542-486e-42d1-8f73-7f753ad6bc62" status: 202 len: 0 microversion: 2.1 time: 0.284997 Jul 25 05:42:14.574868 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 252/510] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:42:14 2022] DELETE /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-volume_attachments/96a1e542-486e-42d1-8f73-7f753ad6bc62 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:42:14.586370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e50559a5-a4e3-4f35-82d1-0ccc608ebf0b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:14.588329 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e50559a5-a4e3-4f35-82d1-0ccc608ebf0b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:14.597158 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e50559a5-a4e3-4f35-82d1-0ccc608ebf0b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:14.599102 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e50559a5-a4e3-4f35-82d1-0ccc608ebf0b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:14.599501 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e50559a5-a4e3-4f35-82d1-0ccc608ebf0b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:14.599958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e50559a5-a4e3-4f35-82d1-0ccc608ebf0b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:14.635242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e50559a5-a4e3-4f35-82d1-0ccc608ebf0b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055805 Jul 25 05:42:14.635825 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 259/511] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:42:14 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:42:15.493730 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0bd38d3a-d21e-44d6-92e3-f75bfb989090 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:15.494915 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0bd38d3a-d21e-44d6-92e3-f75bfb989090 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:15.503476 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bd38d3a-d21e-44d6-92e3-f75bfb989090 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.504135 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bd38d3a-d21e-44d6-92e3-f75bfb989090 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:15.505413 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bd38d3a-d21e-44d6-92e3-f75bfb989090 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.505979 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bd38d3a-d21e-44d6-92e3-f75bfb989090 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:15.544273 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0bd38d3a-d21e-44d6-92e3-f75bfb989090 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055449 Jul 25 05:42:15.550901 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 253/512] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:42:15 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 05:42:15.632029 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-aeec7cbc-ef57-4ebf-b5b7-821d7272cfc0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:15.632609 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-aeec7cbc-ef57-4ebf-b5b7-821d7272cfc0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:15.640191 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeec7cbc-ef57-4ebf-b5b7-821d7272cfc0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.640659 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeec7cbc-ef57-4ebf-b5b7-821d7272cfc0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:15.642086 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeec7cbc-ef57-4ebf-b5b7-821d7272cfc0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.645251 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aeec7cbc-ef57-4ebf-b5b7-821d7272cfc0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:15.648273 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4c35495f-921b-4817-9e8a-9e416a70cce7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:15.650043 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4c35495f-921b-4817-9e8a-9e416a70cce7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:15.656173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4c35495f-921b-4817-9e8a-9e416a70cce7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.657823 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4c35495f-921b-4817-9e8a-9e416a70cce7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:15.659167 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4c35495f-921b-4817-9e8a-9e416a70cce7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.659874 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4c35495f-921b-4817-9e8a-9e416a70cce7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:15.685394 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-aeec7cbc-ef57-4ebf-b5b7-821d7272cfc0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Going to try to terminate instance {{(pid=124467) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:42:15.699883 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4c35495f-921b-4817-9e8a-9e416a70cce7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056118 Jul 25 05:42:15.700896 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 254/513] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:42:15 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 05:42:15.800975 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-acc0ed36-87ea-4d42-ae06-9534f040bda2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:15.801905 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-acc0ed36-87ea-4d42-ae06-9534f040bda2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:15.808073 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-acc0ed36-87ea-4d42-ae06-9534f040bda2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.808545 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-acc0ed36-87ea-4d42-ae06-9534f040bda2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:15.810059 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-acc0ed36-87ea-4d42-ae06-9534f040bda2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.810059 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-acc0ed36-87ea-4d42-ae06-9534f040bda2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:15.812000 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-aeec7cbc-ef57-4ebf-b5b7-821d7272cfc0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 204 len: 0 microversion: 2.1 time: 0.184836 Jul 25 05:42:15.812144 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 260/514] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:42:15 2022] DELETE /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:42:15.835793 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7f421f83-34a9-4cb0-a1de-37509be952a1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:15.837697 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7f421f83-34a9-4cb0-a1de-37509be952a1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:15.841136 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-acc0ed36-87ea-4d42-ae06-9534f040bda2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:42:15.849843 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f421f83-34a9-4cb0-a1de-37509be952a1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.850305 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f421f83-34a9-4cb0-a1de-37509be952a1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:15.851086 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f421f83-34a9-4cb0-a1de-37509be952a1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.851524 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f421f83-34a9-4cb0-a1de-37509be952a1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:15.933263 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-acc0ed36-87ea-4d42-ae06-9534f040bda2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 204 len: 0 microversion: 2.1 time: 0.135804 Jul 25 05:42:15.936990 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 255/515] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:42:15 2022] DELETE /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 05:42:15.949022 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9c82911f-5346-45cb-8ef8-cf312549672e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:15.949827 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9c82911f-5346-45cb-8ef8-cf312549672e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:15.961365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c82911f-5346-45cb-8ef8-cf312549672e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.962257 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c82911f-5346-45cb-8ef8-cf312549672e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:15.964059 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c82911f-5346-45cb-8ef8-cf312549672e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:15.965335 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c82911f-5346-45cb-8ef8-cf312549672e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:16.157457 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7f421f83-34a9-4cb0-a1de-37509be952a1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:16.165994 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7f421f83-34a9-4cb0-a1de-37509be952a1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1690 microversion: 2.1 time: 0.347228 Jul 25 05:42:16.166886 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 261/516] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:15 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1690 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:16.213122 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9c82911f-5346-45cb-8ef8-cf312549672e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:16.221665 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9c82911f-5346-45cb-8ef8-cf312549672e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1682 microversion: 2.1 time: 0.277595 Jul 25 05:42:16.222232 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 256/517] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:15 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1682 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:17.183397 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-17dd4d9d-1c52-4d0c-8e6a-2c4c41034048 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:17.184631 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-17dd4d9d-1c52-4d0c-8e6a-2c4c41034048 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:17.200036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-17dd4d9d-1c52-4d0c-8e6a-2c4c41034048 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:17.200727 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-17dd4d9d-1c52-4d0c-8e6a-2c4c41034048 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:17.201964 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-17dd4d9d-1c52-4d0c-8e6a-2c4c41034048 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:17.202656 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-17dd4d9d-1c52-4d0c-8e6a-2c4c41034048 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:17.240313 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fba8affc-cf04-48fb-9a58-171f93212d78 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:17.243493 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fba8affc-cf04-48fb-9a58-171f93212d78 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:17.259986 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fba8affc-cf04-48fb-9a58-171f93212d78 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:17.260811 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fba8affc-cf04-48fb-9a58-171f93212d78 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:17.261800 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fba8affc-cf04-48fb-9a58-171f93212d78 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:17.262465 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fba8affc-cf04-48fb-9a58-171f93212d78 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:17.507474 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-17dd4d9d-1c52-4d0c-8e6a-2c4c41034048 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:17.517928 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-17dd4d9d-1c52-4d0c-8e6a-2c4c41034048 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1690 microversion: 2.1 time: 0.338285 Jul 25 05:42:17.518660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 262/518] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:17 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1690 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:17.537082 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fba8affc-cf04-48fb-9a58-171f93212d78 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:17.544632 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fba8affc-cf04-48fb-9a58-171f93212d78 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1682 microversion: 2.1 time: 0.308872 Jul 25 05:42:17.545282 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 257/519] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:17 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1682 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:18.536218 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-742fcf85-8f6e-49b1-a6e4-43458558451d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:18.536873 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-742fcf85-8f6e-49b1-a6e4-43458558451d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:18.543101 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-742fcf85-8f6e-49b1-a6e4-43458558451d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:18.543462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-742fcf85-8f6e-49b1-a6e4-43458558451d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:18.544229 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-742fcf85-8f6e-49b1-a6e4-43458558451d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:18.544878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-742fcf85-8f6e-49b1-a6e4-43458558451d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:18.568516 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e68d6a46-654d-49a5-b0ab-7c5d8b83e57e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:18.570097 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e68d6a46-654d-49a5-b0ab-7c5d8b83e57e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:18.580660 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e68d6a46-654d-49a5-b0ab-7c5d8b83e57e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:18.581629 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e68d6a46-654d-49a5-b0ab-7c5d8b83e57e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:18.582653 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e68d6a46-654d-49a5-b0ab-7c5d8b83e57e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:18.583624 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e68d6a46-654d-49a5-b0ab-7c5d8b83e57e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:18.746376 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-742fcf85-8f6e-49b1-a6e4-43458558451d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:18.763332 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-742fcf85-8f6e-49b1-a6e4-43458558451d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1690 microversion: 2.1 time: 0.231943 Jul 25 05:42:18.764586 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 263/520] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:18 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1690 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:18.810376 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e68d6a46-654d-49a5-b0ab-7c5d8b83e57e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:18.819850 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e68d6a46-654d-49a5-b0ab-7c5d8b83e57e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1682 microversion: 2.1 time: 0.259262 Jul 25 05:42:18.821009 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 258/521] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:18 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1682 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:19.780662 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d126f9b3-3df3-4bfd-80e4-ad4b6347f4cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:19.781580 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d126f9b3-3df3-4bfd-80e4-ad4b6347f4cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:19.788188 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d126f9b3-3df3-4bfd-80e4-ad4b6347f4cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:19.788862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d126f9b3-3df3-4bfd-80e4-ad4b6347f4cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:19.789634 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d126f9b3-3df3-4bfd-80e4-ad4b6347f4cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:19.790078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d126f9b3-3df3-4bfd-80e4-ad4b6347f4cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:19.838711 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4ca93f57-99ce-44ad-b60a-968990bb401e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:19.839476 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4ca93f57-99ce-44ad-b60a-968990bb401e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:19.849490 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ca93f57-99ce-44ad-b60a-968990bb401e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:19.850341 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ca93f57-99ce-44ad-b60a-968990bb401e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:19.854318 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ca93f57-99ce-44ad-b60a-968990bb401e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:19.856337 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ca93f57-99ce-44ad-b60a-968990bb401e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:20.028090 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d126f9b3-3df3-4bfd-80e4-ad4b6347f4cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:20.039475 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d126f9b3-3df3-4bfd-80e4-ad4b6347f4cc tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1690 microversion: 2.1 time: 0.262329 Jul 25 05:42:20.040405 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 264/522] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:19 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1690 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:20.071621 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4ca93f57-99ce-44ad-b60a-968990bb401e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:20.079755 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4ca93f57-99ce-44ad-b60a-968990bb401e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1682 microversion: 2.1 time: 0.245534 Jul 25 05:42:20.080428 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 259/523] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:19 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1682 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:21.061342 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cb5510df-a5b2-49c3-b005-65562776a143 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:21.061969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-cb5510df-a5b2-49c3-b005-65562776a143 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:21.069412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cb5510df-a5b2-49c3-b005-65562776a143 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:21.069871 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cb5510df-a5b2-49c3-b005-65562776a143 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:21.070701 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cb5510df-a5b2-49c3-b005-65562776a143 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:21.071323 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cb5510df-a5b2-49c3-b005-65562776a143 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:21.098440 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bc87fb18-8dc4-4cd5-95cb-4dbf05c3595b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:21.099697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bc87fb18-8dc4-4cd5-95cb-4dbf05c3595b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:21.112389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc87fb18-8dc4-4cd5-95cb-4dbf05c3595b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:21.114675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc87fb18-8dc4-4cd5-95cb-4dbf05c3595b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:21.115755 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc87fb18-8dc4-4cd5-95cb-4dbf05c3595b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:21.118380 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc87fb18-8dc4-4cd5-95cb-4dbf05c3595b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:21.361898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cb5510df-a5b2-49c3-b005-65562776a143 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:21.374006 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cb5510df-a5b2-49c3-b005-65562776a143 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1690 microversion: 2.1 time: 0.320018 Jul 25 05:42:21.376240 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 265/524] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:21 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1690 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:21.381312 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bc87fb18-8dc4-4cd5-95cb-4dbf05c3595b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:21.390327 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bc87fb18-8dc4-4cd5-95cb-4dbf05c3595b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1682 microversion: 2.1 time: 0.296857 Jul 25 05:42:21.392489 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 260/525] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:21 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1682 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:22.394318 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2ce8ceec-f431-4bdb-9d1c-588eae74fbb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:22.395567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2ce8ceec-f431-4bdb-9d1c-588eae74fbb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:22.409522 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4fb0d001-cef6-418e-a3be-d215765752e9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:22.410464 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2ce8ceec-f431-4bdb-9d1c-588eae74fbb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:22.410789 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4fb0d001-cef6-418e-a3be-d215765752e9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:22.411414 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2ce8ceec-f431-4bdb-9d1c-588eae74fbb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:22.413395 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2ce8ceec-f431-4bdb-9d1c-588eae74fbb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:22.416732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2ce8ceec-f431-4bdb-9d1c-588eae74fbb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:22.426735 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4fb0d001-cef6-418e-a3be-d215765752e9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:22.426864 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4fb0d001-cef6-418e-a3be-d215765752e9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:22.427560 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4fb0d001-cef6-418e-a3be-d215765752e9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:22.428004 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4fb0d001-cef6-418e-a3be-d215765752e9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:23.083325 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2ce8ceec-f431-4bdb-9d1c-588eae74fbb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:23.097446 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2ce8ceec-f431-4bdb-9d1c-588eae74fbb3 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1690 microversion: 2.1 time: 0.708384 Jul 25 05:42:23.100622 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 266/526] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:22 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1690 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:23.265752 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4fb0d001-cef6-418e-a3be-d215765752e9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:23.274183 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4fb0d001-cef6-418e-a3be-d215765752e9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1682 microversion: 2.1 time: 0.869226 Jul 25 05:42:23.282298 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 261/527] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:22 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1682 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:24.114395 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e57bbff1-d52e-427b-8a73-0e5a5108e3b5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:24.115024 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e57bbff1-d52e-427b-8a73-0e5a5108e3b5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:24.124817 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e57bbff1-d52e-427b-8a73-0e5a5108e3b5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:24.125278 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e57bbff1-d52e-427b-8a73-0e5a5108e3b5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:24.129254 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e57bbff1-d52e-427b-8a73-0e5a5108e3b5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:24.129916 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e57bbff1-d52e-427b-8a73-0e5a5108e3b5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:24.242860 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e57bbff1-d52e-427b-8a73-0e5a5108e3b5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:24.253806 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:24.256173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e57bbff1-d52e-427b-8a73-0e5a5108e3b5 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 200 len: 1622 microversion: 2.1 time: 0.146189 Jul 25 05:42:24.259178 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 267/528] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:24 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 1622 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:24.299703 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-64722339-8b01-4d65-81b9-2c2e5f36f7b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:24.300410 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-64722339-8b01-4d65-81b9-2c2e5f36f7b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:24.307638 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64722339-8b01-4d65-81b9-2c2e5f36f7b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:24.308382 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64722339-8b01-4d65-81b9-2c2e5f36f7b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:24.309367 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64722339-8b01-4d65-81b9-2c2e5f36f7b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:24.309969 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64722339-8b01-4d65-81b9-2c2e5f36f7b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:24.352235 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-7f9e9361-2f6f-46f5-acd4-dfced34c0da0 req-50bc71fb-c60d-41ca-a27f-8f56093f60af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa", "name": "network-vif-deleted", "tag": "db49e6cc-810b-4a89-a2fb-e0718b506f4b"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:24.380420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-7f9e9361-2f6f-46f5-acd4-dfced34c0da0 req-50bc71fb-c60d-41ca-a27f-8f56093f60af service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:24.380903 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-7f9e9361-2f6f-46f5-acd4-dfced34c0da0 req-50bc71fb-c60d-41ca-a27f-8f56093f60af service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:24.408383 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-7f9e9361-2f6f-46f5-acd4-dfced34c0da0 req-50bc71fb-c60d-41ca-a27f-8f56093f60af service nova] Creating event network-vif-deleted:db49e6cc-810b-4a89-a2fb-e0718b506f4b for instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa on hv-cinder-85083 Jul 25 05:42:24.430235 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-7f9e9361-2f6f-46f5-acd4-dfced34c0da0 req-50bc71fb-c60d-41ca-a27f-8f56093f60af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081460 Jul 25 05:42:24.431154 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 268/529] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:42:24.540452 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-64722339-8b01-4d65-81b9-2c2e5f36f7b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:24.561992 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-64722339-8b01-4d65-81b9-2c2e5f36f7b8 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1615 microversion: 2.1 time: 0.266111 Jul 25 05:42:24.562609 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 262/530] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:24 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1615 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:25.275555 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a89efc14-4a36-4b46-886e-f1811789a482 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:25.276608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a89efc14-4a36-4b46-886e-f1811789a482 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:25.287114 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a89efc14-4a36-4b46-886e-f1811789a482 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:25.287571 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a89efc14-4a36-4b46-886e-f1811789a482 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:25.288420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a89efc14-4a36-4b46-886e-f1811789a482 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:25.288892 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a89efc14-4a36-4b46-886e-f1811789a482 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:25.306861 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-a89efc14-4a36-4b46-886e-f1811789a482 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] HTTP exception thrown: Instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa could not be found. Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a89efc14-4a36-4b46-886e-f1811789a482 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Request method failure captured: Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa HTTP/1.1 Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwGlH116eE9G9ee7Lm8JbUWiAPDu8YN3efd6rqcOJFGqiqIvx-Z4bkyaOgt73L_olv3J7RnJmzhVyekt9wWkZaL54kuiNpYanVEwj12N03q2Ucu7IGSA5oKP8wI9kg26x-Wl7rEFaGGhyw8DEAlUPLkVAIgJLPtlKNbsgMEc5Hn6Y8 Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: c782b01e8e484fe8bb710aeddc0192d1 Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:42:25.308527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c782b01e8e484fe8bb710aeddc0192d1"}]}] Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: c782b01e8e484fe8bb710aeddc0192d1 Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-ServerRescueNegativeTestJSON-1264352499-project Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 37c1bb8500f74013b073febfc0d96217 Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1264352499-project Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa could not be found. Jul 25 05:42:25.310200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa'} Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa could not be found. Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:42:25.311123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa could not be found. Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa could not be found. Jul 25 05:42:25.312584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:25.314021 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a89efc14-4a36-4b46-886e-f1811789a482 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Returning 404 to user: Instance 6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:42:25.314021 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a89efc14-4a36-4b46-886e-f1811789a482 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa" status: 404 len: 111 microversion: 2.1 time: 0.040084 Jul 25 05:42:25.314021 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 269/531] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:25 2022] GET /compute/v2.1/servers/6293f14f-7e24-4ebf-a435-eaf9fbc0d0aa => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:42:25.321418 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-36b4f4ab-5238-413f-a3ad-1a5c0e804269 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '.version_select at 0x7fcc84467040>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:25.378360 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-36b4f4ab-5238-413f-a3ad-1a5c0e804269 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-408725491" status: 202 len: 0 microversion: 2.1 time: 0.062594 Jul 25 05:42:25.384519 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 263/532] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jul 25 05:42:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-408725491 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:42:25.581454 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f965a4bc-2887-4b6a-a67e-496ea92bdf7e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:25.582468 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f965a4bc-2887-4b6a-a67e-496ea92bdf7e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:25.600279 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f965a4bc-2887-4b6a-a67e-496ea92bdf7e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:25.608685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f965a4bc-2887-4b6a-a67e-496ea92bdf7e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:25.611124 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f965a4bc-2887-4b6a-a67e-496ea92bdf7e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:25.615096 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f965a4bc-2887-4b6a-a67e-496ea92bdf7e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:25.754905 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f965a4bc-2887-4b6a-a67e-496ea92bdf7e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:25.755630 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f965a4bc-2887-4b6a-a67e-496ea92bdf7e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:25.773578 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-f965a4bc-2887-4b6a-a67e-496ea92bdf7e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lazy-loading 'fault' on Instance uuid fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:42:25.940905 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f965a4bc-2887-4b6a-a67e-496ea92bdf7e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:25.964224 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f965a4bc-2887-4b6a-a67e-496ea92bdf7e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 200 len: 1332 microversion: 2.1 time: 0.388372 Jul 25 05:42:25.966188 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 270/533] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:25 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 1332 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:26.528532 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-a0327cec-4056-48c8-b1cc-860a1d031ca2 req-6b011676-ae17-456e-947b-3672ce8aca21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0ce9ee-f993-48f3-81da-8a31b0a2fc21", "name": "network-vif-deleted", "tag": "1d7fd591-303f-4f00-9657-b9203d5271ba"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:26.546996 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a0327cec-4056-48c8-b1cc-860a1d031ca2 req-6b011676-ae17-456e-947b-3672ce8aca21 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:26.548893 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a0327cec-4056-48c8-b1cc-860a1d031ca2 req-6b011676-ae17-456e-947b-3672ce8aca21 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:26.583242 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-a0327cec-4056-48c8-b1cc-860a1d031ca2 req-6b011676-ae17-456e-947b-3672ce8aca21 service nova] Creating event network-vif-deleted:1d7fd591-303f-4f00-9657-b9203d5271ba for instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 on hv-cinder-85083 Jul 25 05:42:26.597679 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-a0327cec-4056-48c8-b1cc-860a1d031ca2 req-6b011676-ae17-456e-947b-3672ce8aca21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075240 Jul 25 05:42:26.598522 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 264/534] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:26.986587 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7f88b46c-3311-4c71-84fc-07c6c1b9acda tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:26.987362 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7f88b46c-3311-4c71-84fc-07c6c1b9acda tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:27.000362 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f88b46c-3311-4c71-84fc-07c6c1b9acda tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:27.004170 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f88b46c-3311-4c71-84fc-07c6c1b9acda tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:27.005264 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f88b46c-3311-4c71-84fc-07c6c1b9acda tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:27.005717 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f88b46c-3311-4c71-84fc-07c6c1b9acda tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:27.025532 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-7f88b46c-3311-4c71-84fc-07c6c1b9acda tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7f88b46c-3311-4c71-84fc-07c6c1b9acda tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 HTTP/1.1 Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:42:27.027576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:42:27.029258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': 'fb0ce9ee-f993-48f3-81da-8a31b0a2fc21'} Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:42:27.030173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:42:27.031679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:27.034991 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7f88b46c-3311-4c71-84fc-07c6c1b9acda tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:42:27.036045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7f88b46c-3311-4c71-84fc-07c6c1b9acda tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 404 len: 111 microversion: 2.1 time: 0.055184 Jul 25 05:42:27.041749 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 271/535] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:26 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:42:27.051074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c2237691-94fd-4a4f-bc35-b0358bfa7d1d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '.version_select at 0x7fcc843e7700>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:27.086102 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c2237691-94fd-4a4f-bc35-b0358bfa7d1d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557419831" status: 202 len: 0 microversion: 2.1 time: 0.043276 Jul 25 05:42:27.088751 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 265/536] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jul 25 05:42:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557419831 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:42:27.985923 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-94ae30ad-10b8-4192-bc29-54c2e95d1d51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: .version_select at 0x7fcc84327940>, body: {"keypair": {"name": "tempest-keypair-2081622421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz5NjS23O06kU4g35ZeD0BfOfOLsVXe9uZ7uODRc93Sm5gw/LHcLc5iott3OmCkatfP2HT4IZyQitx/Q8udI+40U6lhN2k0XRkkaWMPjqjUNaLfhk7vTgQZIB8lwimHvQ=="}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:28.006355 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-94ae30ad-10b8-4192-bc29-54c2e95d1d51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:42:28.024360 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-94ae30ad-10b8-4192-bc29-54c2e95d1d51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for user 69f3276517de4f889dddd3180436ede9 and project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:42:28.053716 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-94ae30ad-10b8-4192-bc29-54c2e95d1d51 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073041 Jul 25 05:42:28.060151 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 272/537] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 25 05:42:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:29.054103 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0dd9bb3f-10b0-4d18-afba-79dba01363f9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:29.055381 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0dd9bb3f-10b0-4d18-afba-79dba01363f9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:29.062682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0dd9bb3f-10b0-4d18-afba-79dba01363f9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:29.063495 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0dd9bb3f-10b0-4d18-afba-79dba01363f9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:29.064474 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0dd9bb3f-10b0-4d18-afba-79dba01363f9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:29.066043 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0dd9bb3f-10b0-4d18-afba-79dba01363f9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:29.105100 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0dd9bb3f-10b0-4d18-afba-79dba01363f9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:42:29.222205 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0dd9bb3f-10b0-4d18-afba-79dba01363f9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 204 len: 0 microversion: 2.1 time: 0.171958 Jul 25 05:42:29.225829 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 266/538] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:42:29 2022] DELETE /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:42:29.233856 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-41f4ca02-c4ba-4983-85f1-8e1eb2e3bdc9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:29.235182 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-41f4ca02-c4ba-4983-85f1-8e1eb2e3bdc9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:29.242994 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-41f4ca02-c4ba-4983-85f1-8e1eb2e3bdc9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:29.243451 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-41f4ca02-c4ba-4983-85f1-8e1eb2e3bdc9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:29.244237 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-41f4ca02-c4ba-4983-85f1-8e1eb2e3bdc9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:29.244679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-41f4ca02-c4ba-4983-85f1-8e1eb2e3bdc9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:29.426624 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-41f4ca02-c4ba-4983-85f1-8e1eb2e3bdc9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:29.434440 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-41f4ca02-c4ba-4983-85f1-8e1eb2e3bdc9 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1508 microversion: 2.1 time: 0.207038 Jul 25 05:42:29.435022 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 273/539] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:29 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:30.070986 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1885492163", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fec420c3-be12-4a0c-92d9-7ad0ead1f91c"}], "security_groups": [{"name": "tempest-securitygroup--1275072722"}], "key_name": "tempest-keypair-2081622421", "user_data": "}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:30.186377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] validate_networks() for [('fec420c3-be12-4a0c-92d9-7ad0ead1f91c', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:42:30.451291 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c25973c9-535f-4fca-8f43-8f24fe060762 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:30.451890 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c25973c9-535f-4fca-8f43-8f24fe060762 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:30.466857 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c25973c9-535f-4fca-8f43-8f24fe060762 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:30.468133 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c25973c9-535f-4fca-8f43-8f24fe060762 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:30.469277 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c25973c9-535f-4fca-8f43-8f24fe060762 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:30.469965 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c25973c9-535f-4fca-8f43-8f24fe060762 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:30.689260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-c25973c9-535f-4fca-8f43-8f24fe060762 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:30.702792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c25973c9-535f-4fca-8f43-8f24fe060762 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1508 microversion: 2.1 time: 0.255197 Jul 25 05:42:30.707794 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 274/540] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:30 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:30.826748 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:42:30.827172 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:42:30.828365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:42:30.828846 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:42:30.829243 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:42:30.841277 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:30.842257 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:30.843226 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:30.843828 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:30.862354 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:42:30.866543 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Getting quotas for user 69f3276517de4f889dddd3180436ede9 and project 42066c73ac8f4e5c883204dfc66245c0. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:42:30.877858 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:42:30.880201 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:42:30.929743 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-258dbde4-4360-4bf4-9964-7e674b64dd46 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.863483 Jul 25 05:42:30.930698 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 267/541] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:42:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:42:30.941997 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a5dfaa07-4035-4020-8b2a-a16e2b677a4f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:30.942636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a5dfaa07-4035-4020-8b2a-a16e2b677a4f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:31.004751 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a5dfaa07-4035-4020-8b2a-a16e2b677a4f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:31.014035 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a5dfaa07-4035-4020-8b2a-a16e2b677a4f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1242 microversion: 2.1 time: 0.077202 Jul 25 05:42:31.015240 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 275/542] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:30 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:31.725255 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e9839986-8697-4aea-8df1-8a795f232a41 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:31.726512 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e9839986-8697-4aea-8df1-8a795f232a41 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:31.733390 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9839986-8697-4aea-8df1-8a795f232a41 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:31.734089 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9839986-8697-4aea-8df1-8a795f232a41 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:31.737795 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9839986-8697-4aea-8df1-8a795f232a41 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:31.738423 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9839986-8697-4aea-8df1-8a795f232a41 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:32.034097 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-46aa5b44-acca-4645-baa8-399f388e984b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:32.035798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-46aa5b44-acca-4645-baa8-399f388e984b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:32.037675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e9839986-8697-4aea-8df1-8a795f232a41 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:32.039963 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:32.049210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46aa5b44-acca-4645-baa8-399f388e984b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:32.049903 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46aa5b44-acca-4645-baa8-399f388e984b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:32.050930 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46aa5b44-acca-4645-baa8-399f388e984b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:32.051705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46aa5b44-acca-4645-baa8-399f388e984b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:32.055909 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e9839986-8697-4aea-8df1-8a795f232a41 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1508 microversion: 2.1 time: 0.335028 Jul 25 05:42:32.056506 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 268/543] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:31 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1508 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:32.152308 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-46aa5b44-acca-4645-baa8-399f388e984b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:32.163699 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-46aa5b44-acca-4645-baa8-399f388e984b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1294 microversion: 2.1 time: 0.135212 Jul 25 05:42:32.174756 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 276/544] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:32 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1294 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:32.913637 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-bb4abbde-d180-469d-9e24-5bc0688ced68 req-aa0cc1b1-07bd-4a53-9228-6d41be62e5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d49b4fd-206c-478c-9078-e3f88faedd9a", "name": "network-vif-deleted", "tag": "ba399b8d-ed3f-49b4-ac2e-afa79260f403"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:32.938650 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-bb4abbde-d180-469d-9e24-5bc0688ced68 req-aa0cc1b1-07bd-4a53-9228-6d41be62e5ef service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:32.939111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-bb4abbde-d180-469d-9e24-5bc0688ced68 req-aa0cc1b1-07bd-4a53-9228-6d41be62e5ef service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:32.970946 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-bb4abbde-d180-469d-9e24-5bc0688ced68 req-aa0cc1b1-07bd-4a53-9228-6d41be62e5ef service nova] Creating event network-vif-deleted:ba399b8d-ed3f-49b4-ac2e-afa79260f403 for instance 8d49b4fd-206c-478c-9078-e3f88faedd9a on hv-cinder-85083 Jul 25 05:42:32.979039 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-bb4abbde-d180-469d-9e24-5bc0688ced68 req-aa0cc1b1-07bd-4a53-9228-6d41be62e5ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242773 Jul 25 05:42:32.980520 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 269/545] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:33.075441 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-015a1823-3e1f-4c74-9c00-9ac68ba2a6be tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:33.076697 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-015a1823-3e1f-4c74-9c00-9ac68ba2a6be tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:33.088168 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-015a1823-3e1f-4c74-9c00-9ac68ba2a6be tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:33.088921 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-015a1823-3e1f-4c74-9c00-9ac68ba2a6be tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:33.089914 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-015a1823-3e1f-4c74-9c00-9ac68ba2a6be tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:33.090530 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-015a1823-3e1f-4c74-9c00-9ac68ba2a6be tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:33.135878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-015a1823-3e1f-4c74-9c00-9ac68ba2a6be tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:33.136459 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-015a1823-3e1f-4c74-9c00-9ac68ba2a6be tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:33.137109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-015a1823-3e1f-4c74-9c00-9ac68ba2a6be tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lazy-loading 'fault' on Instance uuid 8d49b4fd-206c-478c-9078-e3f88faedd9a {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:42:33.191879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e8fa00b6-e774-4caa-a048-f31406c629a5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:33.193594 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e8fa00b6-e774-4caa-a048-f31406c629a5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:33.202620 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-015a1823-3e1f-4c74-9c00-9ac68ba2a6be tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:33.205213 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8fa00b6-e774-4caa-a048-f31406c629a5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:33.205941 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8fa00b6-e774-4caa-a048-f31406c629a5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:33.208488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8fa00b6-e774-4caa-a048-f31406c629a5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:33.209985 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8fa00b6-e774-4caa-a048-f31406c629a5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:33.213262 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-015a1823-3e1f-4c74-9c00-9ac68ba2a6be tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 200 len: 1312 microversion: 2.1 time: 0.142725 Jul 25 05:42:33.216314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 277/546] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:33 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:33.309499 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e8fa00b6-e774-4caa-a048-f31406c629a5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:33.323497 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e8fa00b6-e774-4caa-a048-f31406c629a5 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1300 microversion: 2.1 time: 0.143820 Jul 25 05:42:33.324517 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 270/547] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:33 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1300 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:34.238164 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5b5f2aff-fef8-441d-91bf-95efbecce2f1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:34.240028 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5b5f2aff-fef8-441d-91bf-95efbecce2f1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 8d49b4fd-206c-478c-9078-e3f88faedd9a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:34.249276 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b5f2aff-fef8-441d-91bf-95efbecce2f1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:34.250427 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b5f2aff-fef8-441d-91bf-95efbecce2f1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:34.252585 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b5f2aff-fef8-441d-91bf-95efbecce2f1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:34.253384 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b5f2aff-fef8-441d-91bf-95efbecce2f1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:34.272300 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-5b5f2aff-fef8-441d-91bf-95efbecce2f1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] HTTP exception thrown: Instance 8d49b4fd-206c-478c-9078-e3f88faedd9a could not be found. Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5b5f2aff-fef8-441d-91bf-95efbecce2f1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Request method failure captured: Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a HTTP/1.1 Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwGlH116eE9G9ee7Lm8JbUWiAPDu8YN3efd6rqcOJFGqiqIvx-Z4bkyaOgt73L_olv3J7RnJmzhVyekt9wWkZaL54kuiNpYanVEwj12N03q2Ucu7IGSA5oKP8wI9kg26x-Wl7rEFaGGhyw8DEAlUPLkVAIgJLPtlKNbsgMEc5Hn6Y8 Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: c782b01e8e484fe8bb710aeddc0192d1 Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:42:34.274314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c782b01e8e484fe8bb710aeddc0192d1"}]}] Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: c782b01e8e484fe8bb710aeddc0192d1 Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-ServerRescueNegativeTestJSON-1264352499-project Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 37c1bb8500f74013b073febfc0d96217 Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1264352499-project Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 8d49b4fd-206c-478c-9078-e3f88faedd9a could not be found. Jul 25 05:42:34.275854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '8d49b4fd-206c-478c-9078-e3f88faedd9a'} Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d49b4fd-206c-478c-9078-e3f88faedd9a could not be found. Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:42:34.276688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d49b4fd-206c-478c-9078-e3f88faedd9a could not be found. Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d49b4fd-206c-478c-9078-e3f88faedd9a could not be found. Jul 25 05:42:34.277901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:34.279880 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5b5f2aff-fef8-441d-91bf-95efbecce2f1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Returning 404 to user: Instance 8d49b4fd-206c-478c-9078-e3f88faedd9a could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:42:34.280921 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5b5f2aff-fef8-441d-91bf-95efbecce2f1 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a" status: 404 len: 111 microversion: 2.1 time: 0.051054 Jul 25 05:42:34.282703 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 278/548] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:34 2022] GET /compute/v2.1/servers/8d49b4fd-206c-478c-9078-e3f88faedd9a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:42:34.291566 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-27a7d812-c2a5-40d1-959b-9a95fb9202b0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:34.292819 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-27a7d812-c2a5-40d1-959b-9a95fb9202b0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:34.303234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27a7d812-c2a5-40d1-959b-9a95fb9202b0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:34.304435 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27a7d812-c2a5-40d1-959b-9a95fb9202b0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:34.307546 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27a7d812-c2a5-40d1-959b-9a95fb9202b0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:34.308685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27a7d812-c2a5-40d1-959b-9a95fb9202b0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:34.343260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cd956858-878c-4c69-980d-6bcae8a8f78d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:34.344177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-cd956858-878c-4c69-980d-6bcae8a8f78d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:34.356814 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd956858-878c-4c69-980d-6bcae8a8f78d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:34.359645 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd956858-878c-4c69-980d-6bcae8a8f78d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:34.364998 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-27a7d812-c2a5-40d1-959b-9a95fb9202b0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:42:34.365390 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd956858-878c-4c69-980d-6bcae8a8f78d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:34.366768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd956858-878c-4c69-980d-6bcae8a8f78d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:34.507158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-27a7d812-c2a5-40d1-959b-9a95fb9202b0 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "DELETE /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 204 len: 0 microversion: 2.1 time: 0.216714 Jul 25 05:42:34.508207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 271/549] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:42:34 2022] DELETE /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 05:42:34.520515 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8cc170b4-5d70-4a0a-83e9-4babbd116c94 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:34.524248 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8cc170b4-5d70-4a0a-83e9-4babbd116c94 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:34.539646 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8cc170b4-5d70-4a0a-83e9-4babbd116c94 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:34.540122 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8cc170b4-5d70-4a0a-83e9-4babbd116c94 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:34.540961 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8cc170b4-5d70-4a0a-83e9-4babbd116c94 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:34.541403 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8cc170b4-5d70-4a0a-83e9-4babbd116c94 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:34.741169 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cd956858-878c-4c69-980d-6bcae8a8f78d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:34.749391 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cd956858-878c-4c69-980d-6bcae8a8f78d tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.412786 Jul 25 05:42:34.755411 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 279/550] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:34 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:34.802346 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8cc170b4-5d70-4a0a-83e9-4babbd116c94 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:34.812512 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8cc170b4-5d70-4a0a-83e9-4babbd116c94 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.300168 Jul 25 05:42:34.813862 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 272/551] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:34 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:34.997830 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-0b7a9fa7-f583-4efe-a733-eed30b91dcb9 req-a4c8bc1e-7dda-42a6-9482-ad8f2652ebde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9692b9-6007-40bf-80f1-a00b4a96d599", "tag": "dce542e4-936d-4f42-abff-da12f790ddc3"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:35.009555 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-0b7a9fa7-f583-4efe-a733-eed30b91dcb9 req-a4c8bc1e-7dda-42a6-9482-ad8f2652ebde service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:35.010311 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-0b7a9fa7-f583-4efe-a733-eed30b91dcb9 req-a4c8bc1e-7dda-42a6-9482-ad8f2652ebde service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:35.028903 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-0b7a9fa7-f583-4efe-a733-eed30b91dcb9 req-a4c8bc1e-7dda-42a6-9482-ad8f2652ebde service nova] Creating event network-changed:dce542e4-936d-4f42-abff-da12f790ddc3 for instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 on hv-cinder-85083 Jul 25 05:42:35.037143 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-0b7a9fa7-f583-4efe-a733-eed30b91dcb9 req-a4c8bc1e-7dda-42a6-9482-ad8f2652ebde service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042854 Jul 25 05:42:35.040202 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 280/552] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:35.771869 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-527001ed-f5cb-4ec4-a800-15a9667d5532 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:35.772504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-527001ed-f5cb-4ec4-a800-15a9667d5532 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:35.779390 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-527001ed-f5cb-4ec4-a800-15a9667d5532 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:35.779855 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-527001ed-f5cb-4ec4-a800-15a9667d5532 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:35.780645 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-527001ed-f5cb-4ec4-a800-15a9667d5532 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:35.781125 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-527001ed-f5cb-4ec4-a800-15a9667d5532 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:35.832603 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-81c2a2ed-a558-4bac-8709-f4cc63a421a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:35.834041 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-81c2a2ed-a558-4bac-8709-f4cc63a421a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:35.842115 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-81c2a2ed-a558-4bac-8709-f4cc63a421a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:35.842836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-81c2a2ed-a558-4bac-8709-f4cc63a421a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:35.843834 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-81c2a2ed-a558-4bac-8709-f4cc63a421a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:35.844371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-81c2a2ed-a558-4bac-8709-f4cc63a421a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:36.017305 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-527001ed-f5cb-4ec4-a800-15a9667d5532 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:36.025519 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-527001ed-f5cb-4ec4-a800-15a9667d5532 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.257356 Jul 25 05:42:36.034652 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 273/553] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:35 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:36.053633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-81c2a2ed-a558-4bac-8709-f4cc63a421a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:36.061585 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-81c2a2ed-a558-4bac-8709-f4cc63a421a4 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.235094 Jul 25 05:42:36.062350 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 281/554] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:35 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:36.489670 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-25d85d40-a164-4788-b26c-7615ca5667a3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Action: 'create', calling method: .version_select at 0x7fcc84359a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-854781868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIPfv9GDsyrb2bOb1lkpVPHFy+XGjRG9zGHOknNmdd1UPs6NxOSWQjB3wQwGabS5P/esgGJM7LZ5gPZYm8H5MLwd+AMEq6OykjS9TL1Lddr8WlNHM8V/IOYY/FOThe0MQ=="}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:36.503810 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-25d85d40-a164-4788-b26c-7615ca5667a3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Getting quotas for project 987ce20ceedd49cb9419cc506c50fce3. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:42:36.507551 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-25d85d40-a164-4788-b26c-7615ca5667a3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Getting quotas for user 598f7eff11f545a88d339812207f0f19 and project 987ce20ceedd49cb9419cc506c50fce3. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:42:36.529258 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-25d85d40-a164-4788-b26c-7615ca5667a3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044414 Jul 25 05:42:36.529839 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 274/555] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 25 05:42:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:36.582501 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-437683866", "imageRef": "c716a79d-8d89-48f6-85bb-c547ff596fc8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-854781868", "networks": [{"uuid": "69a407fc-7892-4489-9edc-cabb773af8c0"}]}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:36.631457 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.network.neutron [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] validate_networks() for [('69a407fc-7892-4489-9edc-cabb773af8c0', None, None, None, None, None)] {{(pid=124467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:42:36.748813 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b6d57219-7bdc-4673-b305-6b9c9de6e504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:36.749749 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b6d57219-7bdc-4673-b305-6b9c9de6e504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:36.756091 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b6d57219-7bdc-4673-b305-6b9c9de6e504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:36.756551 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b6d57219-7bdc-4673-b305-6b9c9de6e504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:36.757347 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b6d57219-7bdc-4673-b305-6b9c9de6e504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:36.757789 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b6d57219-7bdc-4673-b305-6b9c9de6e504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:36.787693 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b6d57219-7bdc-4673-b305-6b9c9de6e504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042780 Jul 25 05:42:36.788416 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 275/556] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:42:36 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 05:42:36.848894 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6e36f6eb-fadf-4df7-ba69-d6438ff46d9a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:36.849488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6e36f6eb-fadf-4df7-ba69-d6438ff46d9a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:36.855447 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e36f6eb-fadf-4df7-ba69-d6438ff46d9a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:36.855980 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e36f6eb-fadf-4df7-ba69-d6438ff46d9a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:36.856837 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e36f6eb-fadf-4df7-ba69-d6438ff46d9a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:36.857349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e36f6eb-fadf-4df7-ba69-d6438ff46d9a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:36.882188 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6e36f6eb-fadf-4df7-ba69-d6438ff46d9a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:42:36.943231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:36.962234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6e36f6eb-fadf-4df7-ba69-d6438ff46d9a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 204 len: 0 microversion: 2.1 time: 0.116996 Jul 25 05:42:36.962808 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 276/557] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:42:36 2022] DELETE /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 05:42:36.971912 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d23a2587-1573-4ef3-a86e-24214f1246e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:36.972616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d23a2587-1573-4ef3-a86e-24214f1246e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:36.978850 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d23a2587-1573-4ef3-a86e-24214f1246e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:36.979304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d23a2587-1573-4ef3-a86e-24214f1246e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:36.980069 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d23a2587-1573-4ef3-a86e-24214f1246e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:36.980515 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d23a2587-1573-4ef3-a86e-24214f1246e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:37.032513 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Flavor limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:42:37.033176 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Image limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:42:37.033656 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Flavor pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:42:37.034093 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Image pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:42:37.034502 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:42:37.044116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:37.044558 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:37.045399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:37.045818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:37.063092 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Getting quotas for project 987ce20ceedd49cb9419cc506c50fce3. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:42:37.067197 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Getting quotas for user 598f7eff11f545a88d339812207f0f19 and project 987ce20ceedd49cb9419cc506c50fce3. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:42:37.078221 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Going to run 1 instances... {{(pid=124467) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:42:37.080665 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c716a79d-8d89-48f6-85bb-c547ff596fc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:42:37.117783 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d23a2587-1573-4ef3-a86e-24214f1246e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:37.125240 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d23a2587-1573-4ef3-a86e-24214f1246e9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1674 microversion: 2.1 time: 0.158058 Jul 25 05:42:37.125843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 277/558] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:36 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:37.128126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-acc83de3-5d42-443b-b7aa-8b98032e97fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551054 Jul 25 05:42:37.133518 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 282/559] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:42:37.133518 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-be94372f-94d0-4000-9afd-06681cc2d11d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:37.134125 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-be94372f-94d0-4000-9afd-06681cc2d11d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:37.139784 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-210a7d31-fc6e-488c-8ab1-bc4e9624a887 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:37.140407 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-210a7d31-fc6e-488c-8ab1-bc4e9624a887 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:37.140518 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-be94372f-94d0-4000-9afd-06681cc2d11d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:37.140908 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-be94372f-94d0-4000-9afd-06681cc2d11d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:37.142211 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-be94372f-94d0-4000-9afd-06681cc2d11d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:37.142872 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-be94372f-94d0-4000-9afd-06681cc2d11d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:37.147211 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-210a7d31-fc6e-488c-8ab1-bc4e9624a887 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:37.147676 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-210a7d31-fc6e-488c-8ab1-bc4e9624a887 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:37.148458 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-210a7d31-fc6e-488c-8ab1-bc4e9624a887 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:37.148936 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-210a7d31-fc6e-488c-8ab1-bc4e9624a887 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:37.351703 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-be94372f-94d0-4000-9afd-06681cc2d11d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:37.355762 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-210a7d31-fc6e-488c-8ab1-bc4e9624a887 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:37.359481 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-be94372f-94d0-4000-9afd-06681cc2d11d tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.229698 Jul 25 05:42:37.364918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-210a7d31-fc6e-488c-8ab1-bc4e9624a887 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.228773 Jul 25 05:42:37.374399 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 278/560] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:37 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:37.374580 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 283/561] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:37 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:37.374691 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6d9995d1-3207-492c-b75a-631455d62273 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:37.374691 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6d9995d1-3207-492c-b75a-631455d62273 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:37.426763 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6d9995d1-3207-492c-b75a-631455d62273 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:37.434599 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6d9995d1-3207-492c-b75a-631455d62273 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1257 microversion: 2.1 time: 0.068077 Jul 25 05:42:37.435248 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 279/562] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:37 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:37.684773 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5b43c96f-8644-47fd-b3fb-29c1c26a7810 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:37.685320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5b43c96f-8644-47fd-b3fb-29c1c26a7810 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:37.691607 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b43c96f-8644-47fd-b3fb-29c1c26a7810 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:37.692062 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b43c96f-8644-47fd-b3fb-29c1c26a7810 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:37.692865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b43c96f-8644-47fd-b3fb-29c1c26a7810 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:37.693310 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b43c96f-8644-47fd-b3fb-29c1c26a7810 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:37.718356 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5b43c96f-8644-47fd-b3fb-29c1c26a7810 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Going to try to terminate instance {{(pid=124467) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:42:37.791298 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:37.799643 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5b43c96f-8644-47fd-b3fb-29c1c26a7810 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 204 len: 0 microversion: 2.1 time: 0.118563 Jul 25 05:42:37.800815 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 284/563] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:42:37 2022] DELETE /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:42:37.808547 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2c4af651-c485-4929-96d5-06f898644da0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:37.809555 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2c4af651-c485-4929-96d5-06f898644da0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:37.816486 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c4af651-c485-4929-96d5-06f898644da0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:37.816996 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c4af651-c485-4929-96d5-06f898644da0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:37.817763 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c4af651-c485-4929-96d5-06f898644da0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:37.818238 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c4af651-c485-4929-96d5-06f898644da0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:37.948218 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2c4af651-c485-4929-96d5-06f898644da0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:37.957057 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2c4af651-c485-4929-96d5-06f898644da0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1580 microversion: 2.1 time: 0.152322 Jul 25 05:42:37.957625 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 280/564] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:37 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1580 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:38.143944 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-80f83b1e-10f4-4408-a449-0dbe047a1d13 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:38.144648 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-80f83b1e-10f4-4408-a449-0dbe047a1d13 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:38.151496 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80f83b1e-10f4-4408-a449-0dbe047a1d13 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:38.151947 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80f83b1e-10f4-4408-a449-0dbe047a1d13 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:38.152708 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80f83b1e-10f4-4408-a449-0dbe047a1d13 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:38.153181 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-80f83b1e-10f4-4408-a449-0dbe047a1d13 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:38.283580 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-80f83b1e-10f4-4408-a449-0dbe047a1d13 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:38.291073 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-80f83b1e-10f4-4408-a449-0dbe047a1d13 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1674 microversion: 2.1 time: 0.152354 Jul 25 05:42:38.291644 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 285/565] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:38 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:38.377168 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-950279db-77ae-4755-908b-1cb9093436e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:38.377776 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-950279db-77ae-4755-908b-1cb9093436e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:38.382070 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6462ae30-6d91-4af8-8fb6-7f2ca50d8818 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:38.382688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6462ae30-6d91-4af8-8fb6-7f2ca50d8818 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:38.383687 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-950279db-77ae-4755-908b-1cb9093436e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:38.384137 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-950279db-77ae-4755-908b-1cb9093436e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:38.384925 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-950279db-77ae-4755-908b-1cb9093436e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:38.385364 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-950279db-77ae-4755-908b-1cb9093436e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:38.388674 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6462ae30-6d91-4af8-8fb6-7f2ca50d8818 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:38.390211 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6462ae30-6d91-4af8-8fb6-7f2ca50d8818 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:38.390211 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6462ae30-6d91-4af8-8fb6-7f2ca50d8818 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:38.390413 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6462ae30-6d91-4af8-8fb6-7f2ca50d8818 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:38.587118 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-950279db-77ae-4755-908b-1cb9093436e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:38.590116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6462ae30-6d91-4af8-8fb6-7f2ca50d8818 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:38.595113 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-950279db-77ae-4755-908b-1cb9093436e6 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.222264 Jul 25 05:42:38.595880 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 281/566] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:38 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:38.598654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6462ae30-6d91-4af8-8fb6-7f2ca50d8818 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.220273 Jul 25 05:42:38.599388 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 286/567] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:38 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:38.600095 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e32e3853-0769-49a3-8648-de11034a8a42 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:38.600709 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e32e3853-0769-49a3-8648-de11034a8a42 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:38.606568 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e32e3853-0769-49a3-8648-de11034a8a42 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:38.607024 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e32e3853-0769-49a3-8648-de11034a8a42 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:38.607797 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e32e3853-0769-49a3-8648-de11034a8a42 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:38.608248 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e32e3853-0769-49a3-8648-de11034a8a42 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:38.672158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e32e3853-0769-49a3-8648-de11034a8a42 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:38.680101 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e32e3853-0769-49a3-8648-de11034a8a42 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1261 microversion: 2.1 time: 0.083469 Jul 25 05:42:38.680660 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 282/568] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:38 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:38.974242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d128e390-8a8e-4f02-9a37-fb35b06ee5b2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:38.974887 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d128e390-8a8e-4f02-9a37-fb35b06ee5b2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:38.981116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d128e390-8a8e-4f02-9a37-fb35b06ee5b2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:38.981617 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d128e390-8a8e-4f02-9a37-fb35b06ee5b2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:38.982378 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d128e390-8a8e-4f02-9a37-fb35b06ee5b2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:38.982845 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d128e390-8a8e-4f02-9a37-fb35b06ee5b2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:39.112616 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d128e390-8a8e-4f02-9a37-fb35b06ee5b2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:39.120121 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d128e390-8a8e-4f02-9a37-fb35b06ee5b2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1580 microversion: 2.1 time: 0.149737 Jul 25 05:42:39.120687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 287/569] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:38 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1580 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:39.308173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f75b7b78-c18a-4572-af4b-9e76b6a87ad4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:39.308856 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f75b7b78-c18a-4572-af4b-9e76b6a87ad4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:39.315929 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f75b7b78-c18a-4572-af4b-9e76b6a87ad4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:39.316514 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f75b7b78-c18a-4572-af4b-9e76b6a87ad4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:39.317498 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f75b7b78-c18a-4572-af4b-9e76b6a87ad4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:39.317859 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f75b7b78-c18a-4572-af4b-9e76b6a87ad4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:39.450302 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f75b7b78-c18a-4572-af4b-9e76b6a87ad4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:39.458273 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f75b7b78-c18a-4572-af4b-9e76b6a87ad4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1674 microversion: 2.1 time: 0.153921 Jul 25 05:42:39.458846 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 283/570] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:39 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:39.612931 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-fc59e0f2-0982-4628-b349-cbb019e3724a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:39.613486 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-fc59e0f2-0982-4628-b349-cbb019e3724a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:39.615895 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-60e5ec16-1ff1-4d32-889b-ac0eaa447253 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:39.616571 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-60e5ec16-1ff1-4d32-889b-ac0eaa447253 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:39.620049 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fc59e0f2-0982-4628-b349-cbb019e3724a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:39.620499 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fc59e0f2-0982-4628-b349-cbb019e3724a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:39.621287 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fc59e0f2-0982-4628-b349-cbb019e3724a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:39.621727 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fc59e0f2-0982-4628-b349-cbb019e3724a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:39.622567 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60e5ec16-1ff1-4d32-889b-ac0eaa447253 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:39.623028 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60e5ec16-1ff1-4d32-889b-ac0eaa447253 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:39.623798 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60e5ec16-1ff1-4d32-889b-ac0eaa447253 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:39.624277 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:39.624447 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60e5ec16-1ff1-4d32-889b-ac0eaa447253 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:39.831048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-60e5ec16-1ff1-4d32-889b-ac0eaa447253 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:39.833295 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:39.834990 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-fc59e0f2-0982-4628-b349-cbb019e3724a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:39.841368 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-60e5ec16-1ff1-4d32-889b-ac0eaa447253 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.229170 Jul 25 05:42:39.843836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 284/571] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:39 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:39.843999 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-fc59e0f2-0982-4628-b349-cbb019e3724a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.234491 Jul 25 05:42:39.843999 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 288/572] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:39 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:39.847841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ec13febf-e7b8-4ade-b124-8346c8d99535 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:39.848457 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ec13febf-e7b8-4ade-b124-8346c8d99535 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:39.855142 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec13febf-e7b8-4ade-b124-8346c8d99535 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:39.855601 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec13febf-e7b8-4ade-b124-8346c8d99535 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:39.856483 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec13febf-e7b8-4ade-b124-8346c8d99535 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:39.856946 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec13febf-e7b8-4ade-b124-8346c8d99535 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:39.916994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ec13febf-e7b8-4ade-b124-8346c8d99535 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:39.926455 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ec13febf-e7b8-4ade-b124-8346c8d99535 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1253 microversion: 2.1 time: 0.082626 Jul 25 05:42:39.927518 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 285/573] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:39 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1253 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:40.137225 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-35edcc72-1b4d-4d65-b27b-6845693664f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:40.137829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-35edcc72-1b4d-4d65-b27b-6845693664f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:40.144676 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-35edcc72-1b4d-4d65-b27b-6845693664f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:40.145151 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-35edcc72-1b4d-4d65-b27b-6845693664f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:40.145902 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-35edcc72-1b4d-4d65-b27b-6845693664f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:40.146339 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-35edcc72-1b4d-4d65-b27b-6845693664f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:40.278312 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-35edcc72-1b4d-4d65-b27b-6845693664f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:40.285813 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-35edcc72-1b4d-4d65-b27b-6845693664f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1580 microversion: 2.1 time: 0.152429 Jul 25 05:42:40.286372 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 289/574] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:40 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1580 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:40.475778 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-22e988c9-3170-4d80-a418-b00eda629cfa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:40.476442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-22e988c9-3170-4d80-a418-b00eda629cfa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:40.482837 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22e988c9-3170-4d80-a418-b00eda629cfa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:40.483295 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22e988c9-3170-4d80-a418-b00eda629cfa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:40.484058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22e988c9-3170-4d80-a418-b00eda629cfa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:40.484507 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22e988c9-3170-4d80-a418-b00eda629cfa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:40.612299 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-22e988c9-3170-4d80-a418-b00eda629cfa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:40.619653 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-22e988c9-3170-4d80-a418-b00eda629cfa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1674 microversion: 2.1 time: 0.147831 Jul 25 05:42:40.620212 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 286/575] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:40 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:40.859449 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-393f23ab-2dd4-4217-9064-fb9953d35509 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:40.860946 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-393f23ab-2dd4-4217-9064-fb9953d35509 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:40.861463 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2c220d2f-c9e2-4b44-b828-83fc6b81b3a7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:40.862081 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2c220d2f-c9e2-4b44-b828-83fc6b81b3a7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:40.863912 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:40.867818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-393f23ab-2dd4-4217-9064-fb9953d35509 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:40.868269 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-393f23ab-2dd4-4217-9064-fb9953d35509 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:40.869065 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-393f23ab-2dd4-4217-9064-fb9953d35509 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:40.869414 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c220d2f-c9e2-4b44-b828-83fc6b81b3a7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:40.869624 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-393f23ab-2dd4-4217-9064-fb9953d35509 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:40.869860 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c220d2f-c9e2-4b44-b828-83fc6b81b3a7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:40.870631 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c220d2f-c9e2-4b44-b828-83fc6b81b3a7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:40.871077 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2c220d2f-c9e2-4b44-b828-83fc6b81b3a7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:41.058735 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-393f23ab-2dd4-4217-9064-fb9953d35509 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:41.066536 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2c220d2f-c9e2-4b44-b828-83fc6b81b3a7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:41.066776 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-393f23ab-2dd4-4217-9064-fb9953d35509 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.211158 Jul 25 05:42:41.067362 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 290/576] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:40 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:41.071757 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d781cd70-8f96-477d-b848-cb3321b617f9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:41.072364 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d781cd70-8f96-477d-b848-cb3321b617f9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:41.074073 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2c220d2f-c9e2-4b44-b828-83fc6b81b3a7 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1521 microversion: 2.1 time: 0.217275 Jul 25 05:42:41.082246 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 287/577] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:40 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:41.082433 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d781cd70-8f96-477d-b848-cb3321b617f9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:41.082433 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d781cd70-8f96-477d-b848-cb3321b617f9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:41.082433 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d781cd70-8f96-477d-b848-cb3321b617f9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:41.082433 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d781cd70-8f96-477d-b848-cb3321b617f9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:41.144726 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d781cd70-8f96-477d-b848-cb3321b617f9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:41.152012 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d781cd70-8f96-477d-b848-cb3321b617f9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1253 microversion: 2.1 time: 0.083709 Jul 25 05:42:41.152566 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 291/578] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:41 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1253 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:41.303661 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0a833aa6-9638-479e-acdc-25efb0b09f82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:41.304271 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0a833aa6-9638-479e-acdc-25efb0b09f82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:41.310314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0a833aa6-9638-479e-acdc-25efb0b09f82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:41.310959 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0a833aa6-9638-479e-acdc-25efb0b09f82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:41.311526 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0a833aa6-9638-479e-acdc-25efb0b09f82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:41.311976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0a833aa6-9638-479e-acdc-25efb0b09f82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:41.457496 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0a833aa6-9638-479e-acdc-25efb0b09f82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:41.468328 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0a833aa6-9638-479e-acdc-25efb0b09f82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1580 microversion: 2.1 time: 0.168192 Jul 25 05:42:41.470203 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 288/579] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:41 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1580 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:41.638502 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d4239461-5a39-4599-8b0f-2438f4b913cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:41.639744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d4239461-5a39-4599-8b0f-2438f4b913cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:41.651717 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d4239461-5a39-4599-8b0f-2438f4b913cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:41.651717 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d4239461-5a39-4599-8b0f-2438f4b913cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:41.652586 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d4239461-5a39-4599-8b0f-2438f4b913cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:41.652586 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d4239461-5a39-4599-8b0f-2438f4b913cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:41.936401 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d4239461-5a39-4599-8b0f-2438f4b913cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:41.944641 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d4239461-5a39-4599-8b0f-2438f4b913cd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1674 microversion: 2.1 time: 0.310646 Jul 25 05:42:41.945245 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 292/580] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:41 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1674 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:42.084132 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ebb1cc42-f46e-48c6-9fad-ffca44898f55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:42.085642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ebb1cc42-f46e-48c6-9fad-ffca44898f55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:42.090754 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f119e05e-b1bb-4d4e-bffe-180a5f1636ae tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:42.091613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f119e05e-b1bb-4d4e-bffe-180a5f1636ae tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:42.092912 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebb1cc42-f46e-48c6-9fad-ffca44898f55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.093382 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebb1cc42-f46e-48c6-9fad-ffca44898f55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:42.094151 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebb1cc42-f46e-48c6-9fad-ffca44898f55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.094783 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebb1cc42-f46e-48c6-9fad-ffca44898f55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:42.099264 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f119e05e-b1bb-4d4e-bffe-180a5f1636ae tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.099978 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f119e05e-b1bb-4d4e-bffe-180a5f1636ae tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:42.100945 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f119e05e-b1bb-4d4e-bffe-180a5f1636ae tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.101554 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f119e05e-b1bb-4d4e-bffe-180a5f1636ae tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:42.251882 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f119e05e-b1bb-4d4e-bffe-180a5f1636ae tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:42.276109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f119e05e-b1bb-4d4e-bffe-180a5f1636ae tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1479 microversion: 2.1 time: 0.189008 Jul 25 05:42:42.287617 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 293/581] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:42 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1479 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:42.292827 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9040d353-d29d-4555-a766-2f0df2b68085 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:42.293475 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-9040d353-d29d-4555-a766-2f0df2b68085 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:42.302794 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9040d353-d29d-4555-a766-2f0df2b68085 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.303244 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9040d353-d29d-4555-a766-2f0df2b68085 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:42.304096 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9040d353-d29d-4555-a766-2f0df2b68085 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.304536 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9040d353-d29d-4555-a766-2f0df2b68085 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:42.443939 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9040d353-d29d-4555-a766-2f0df2b68085 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:42.456943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-9040d353-d29d-4555-a766-2f0df2b68085 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1317 microversion: 2.1 time: 0.169878 Jul 25 05:42:42.469106 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 294/582] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:42 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:42.480338 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-90af586d-9fcb-4376-b80c-cb0a6abb2589 req-4db4d9b9-8556-483b-b644-0587e59ab927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12aaf07a-d8f0-46c4-98f9-ba47ee257fa7", "name": "network-vif-deleted", "tag": "6d22bdd7-e942-45f4-b095-81aa2ad4c2d4"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:42.490433 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ebb1cc42-f46e-48c6-9fad-ffca44898f55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:42.495457 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-90af586d-9fcb-4376-b80c-cb0a6abb2589 req-4db4d9b9-8556-483b-b644-0587e59ab927 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.496179 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-90af586d-9fcb-4376-b80c-cb0a6abb2589 req-4db4d9b9-8556-483b-b644-0587e59ab927 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:42.502289 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ebb1cc42-f46e-48c6-9fad-ffca44898f55 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.420474 Jul 25 05:42:42.507933 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 289/583] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:42 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:42.510686 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-de47f6f3-4d95-43df-80c9-ad6bd4f40e68 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:42.511359 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-de47f6f3-4d95-43df-80c9-ad6bd4f40e68 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:42.520264 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de47f6f3-4d95-43df-80c9-ad6bd4f40e68 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.521131 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de47f6f3-4d95-43df-80c9-ad6bd4f40e68 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:42.523018 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de47f6f3-4d95-43df-80c9-ad6bd4f40e68 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.523842 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de47f6f3-4d95-43df-80c9-ad6bd4f40e68 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:42.537217 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-90af586d-9fcb-4376-b80c-cb0a6abb2589 req-4db4d9b9-8556-483b-b644-0587e59ab927 service nova] Creating event network-vif-deleted:6d22bdd7-e942-45f4-b095-81aa2ad4c2d4 for instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 on hv-cinder-85083 Jul 25 05:42:42.553993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-90af586d-9fcb-4376-b80c-cb0a6abb2589 req-4db4d9b9-8556-483b-b644-0587e59ab927 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084329 Jul 25 05:42:42.558641 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 295/584] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:42.732970 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-de47f6f3-4d95-43df-80c9-ad6bd4f40e68 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:42.743821 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-de47f6f3-4d95-43df-80c9-ad6bd4f40e68 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1580 microversion: 2.1 time: 0.238075 Jul 25 05:42:42.744611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 290/585] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:42 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1580 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:42.936138 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-420e5b52-2375-4c15-8808-a65677667b56 req-6aaefd40-d9d1-4a1a-b93c-1aa4f3d3d839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fa910c-7604-4aa9-82ff-477d62f57f54", "name": "network-vif-unplugged", "status": "completed", "tag": "e15bc07d-1abd-455e-907e-fa844fbf01ce"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:42.945860 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-420e5b52-2375-4c15-8808-a65677667b56 req-6aaefd40-d9d1-4a1a-b93c-1aa4f3d3d839 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.946450 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-420e5b52-2375-4c15-8808-a65677667b56 req-6aaefd40-d9d1-4a1a-b93c-1aa4f3d3d839 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:42.960420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-420e5b52-2375-4c15-8808-a65677667b56 req-6aaefd40-d9d1-4a1a-b93c-1aa4f3d3d839 service nova] Creating event network-vif-unplugged:e15bc07d-1abd-455e-907e-fa844fbf01ce for instance f6fa910c-7604-4aa9-82ff-477d62f57f54 on hv-cinder-85083 Jul 25 05:42:42.966343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-420e5b52-2375-4c15-8808-a65677667b56 req-6aaefd40-d9d1-4a1a-b93c-1aa4f3d3d839 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034245 Jul 25 05:42:42.967534 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 296/586] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:42.974300 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e9976a95-531e-4ca6-9b23-b4a029ad0dd4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:42.974997 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e9976a95-531e-4ca6-9b23-b4a029ad0dd4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:42.984097 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9976a95-531e-4ca6-9b23-b4a029ad0dd4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.984487 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9976a95-531e-4ca6-9b23-b4a029ad0dd4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:42.985920 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9976a95-531e-4ca6-9b23-b4a029ad0dd4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:42.986555 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9976a95-531e-4ca6-9b23-b4a029ad0dd4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:43.073522 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e9976a95-531e-4ca6-9b23-b4a029ad0dd4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:43.090339 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e9976a95-531e-4ca6-9b23-b4a029ad0dd4 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1606 microversion: 2.1 time: 0.131994 Jul 25 05:42:43.091271 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 291/587] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:42 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1606 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:43.295158 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4bf271cd-53a7-4f97-b00f-2d5c36e79d37 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:43.296040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4bf271cd-53a7-4f97-b00f-2d5c36e79d37 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:43.310981 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4bf271cd-53a7-4f97-b00f-2d5c36e79d37 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:43.311717 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4bf271cd-53a7-4f97-b00f-2d5c36e79d37 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:43.312696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4bf271cd-53a7-4f97-b00f-2d5c36e79d37 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:43.313989 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4bf271cd-53a7-4f97-b00f-2d5c36e79d37 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:43.355331 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4bf271cd-53a7-4f97-b00f-2d5c36e79d37 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:43.355792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4bf271cd-53a7-4f97-b00f-2d5c36e79d37 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:43.356252 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-4bf271cd-53a7-4f97-b00f-2d5c36e79d37 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lazy-loading 'fault' on Instance uuid 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:42:43.430345 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4bf271cd-53a7-4f97-b00f-2d5c36e79d37 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:43.437867 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4bf271cd-53a7-4f97-b00f-2d5c36e79d37 tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1311 microversion: 2.1 time: 0.147002 Jul 25 05:42:43.439128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 297/588] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:43 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1311 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:43.475877 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a5b3609c-bdca-4a43-9791-1f3cf0419aa4 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:43.476881 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a5b3609c-bdca-4a43-9791-1f3cf0419aa4 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:43.483979 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a5b3609c-bdca-4a43-9791-1f3cf0419aa4 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:43.484828 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a5b3609c-bdca-4a43-9791-1f3cf0419aa4 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:43.486663 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a5b3609c-bdca-4a43-9791-1f3cf0419aa4 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:43.487340 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a5b3609c-bdca-4a43-9791-1f3cf0419aa4 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:43.520179 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6d4049d5-b53b-414a-98f7-a349ca9ea7c2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:43.520558 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6d4049d5-b53b-414a-98f7-a349ca9ea7c2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:43.527770 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6d4049d5-b53b-414a-98f7-a349ca9ea7c2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:43.528233 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6d4049d5-b53b-414a-98f7-a349ca9ea7c2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:43.529115 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6d4049d5-b53b-414a-98f7-a349ca9ea7c2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:43.530121 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6d4049d5-b53b-414a-98f7-a349ca9ea7c2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:43.560086 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a5b3609c-bdca-4a43-9791-1f3cf0419aa4 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:43.568449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a5b3609c-bdca-4a43-9791-1f3cf0419aa4 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1315 microversion: 2.1 time: 0.096339 Jul 25 05:42:43.578085 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 292/589] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:43 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1315 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:43.670687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6d4049d5-b53b-414a-98f7-a349ca9ea7c2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:43.679712 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6d4049d5-b53b-414a-98f7-a349ca9ea7c2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.163917 Jul 25 05:42:43.689470 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 298/590] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:43 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:43.765570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4651789d-bfa3-4379-b6c4-2d741781579b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:43.766690 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4651789d-bfa3-4379-b6c4-2d741781579b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:43.778553 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4651789d-bfa3-4379-b6c4-2d741781579b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:43.779495 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4651789d-bfa3-4379-b6c4-2d741781579b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:43.781229 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4651789d-bfa3-4379-b6c4-2d741781579b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:43.782461 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4651789d-bfa3-4379-b6c4-2d741781579b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:43.788865 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-a0798c10-ab99-4016-a7c1-3ee687043c2f req-155c8c5a-c54d-485d-b17e-5b1da66ea711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4943e050-a915-4850-8e01-9590c5fcde77", "name": "network-vif-deleted", "tag": "95d850ae-eaa4-4645-9536-93c90734b2d8"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:43.807509 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a0798c10-ab99-4016-a7c1-3ee687043c2f req-155c8c5a-c54d-485d-b17e-5b1da66ea711 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:43.808655 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a0798c10-ab99-4016-a7c1-3ee687043c2f req-155c8c5a-c54d-485d-b17e-5b1da66ea711 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:43.821638 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-a0798c10-ab99-4016-a7c1-3ee687043c2f req-155c8c5a-c54d-485d-b17e-5b1da66ea711 service nova] Creating event network-vif-deleted:95d850ae-eaa4-4645-9536-93c90734b2d8 for instance 4943e050-a915-4850-8e01-9590c5fcde77 on hv-cinder-85083 Jul 25 05:42:43.826231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-a0798c10-ab99-4016-a7c1-3ee687043c2f req-155c8c5a-c54d-485d-b17e-5b1da66ea711 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115920 Jul 25 05:42:43.827020 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 293/591] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:43.882321 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4651789d-bfa3-4379-b6c4-2d741781579b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:43.928551 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4651789d-bfa3-4379-b6c4-2d741781579b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1512 microversion: 2.1 time: 0.169335 Jul 25 05:42:43.944408 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 299/592] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:43 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:44.110858 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f03323bf-d3c2-4995-8d72-a55a34b6ccef tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:44.111851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f03323bf-d3c2-4995-8d72-a55a34b6ccef tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:44.122432 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f03323bf-d3c2-4995-8d72-a55a34b6ccef tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:44.122897 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f03323bf-d3c2-4995-8d72-a55a34b6ccef tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:44.134294 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f03323bf-d3c2-4995-8d72-a55a34b6ccef tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:44.134770 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f03323bf-d3c2-4995-8d72-a55a34b6ccef tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:44.378466 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f03323bf-d3c2-4995-8d72-a55a34b6ccef tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:44.396137 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f03323bf-d3c2-4995-8d72-a55a34b6ccef tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1606 microversion: 2.1 time: 0.288927 Jul 25 05:42:44.396639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 294/593] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:44 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1606 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:44.457966 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cda95138-4eba-46f1-8883-d1f1c2208a8f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:44.459421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-cda95138-4eba-46f1-8883-d1f1c2208a8f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:44.477016 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cda95138-4eba-46f1-8883-d1f1c2208a8f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:44.477459 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cda95138-4eba-46f1-8883-d1f1c2208a8f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:44.478281 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cda95138-4eba-46f1-8883-d1f1c2208a8f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:44.478733 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cda95138-4eba-46f1-8883-d1f1c2208a8f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:44.589906 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-52593b54-8866-4996-9776-f0f71b2c994a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:44.590678 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-52593b54-8866-4996-9776-f0f71b2c994a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:44.610958 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52593b54-8866-4996-9776-f0f71b2c994a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:44.611629 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52593b54-8866-4996-9776-f0f71b2c994a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:44.614121 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52593b54-8866-4996-9776-f0f71b2c994a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:44.614758 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52593b54-8866-4996-9776-f0f71b2c994a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:44.646416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cda95138-4eba-46f1-8883-d1f1c2208a8f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:44.646889 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cda95138-4eba-46f1-8883-d1f1c2208a8f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:44.658376 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-cda95138-4eba-46f1-8883-d1f1c2208a8f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lazy-loading 'fault' on Instance uuid 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:42:44.853168 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cda95138-4eba-46f1-8883-d1f1c2208a8f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c1bb8500f74013b073febfc0d96217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c782b01e8e484fe8bb710aeddc0192d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:44.860490 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cda95138-4eba-46f1-8883-d1f1c2208a8f tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 200 len: 1311 microversion: 2.1 time: 0.407681 Jul 25 05:42:44.877460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 300/594] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:44 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 1311 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:44.886109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-afac61c9-83dc-4aaf-aa2b-5a355331adbf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:44.892929 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-afac61c9-83dc-4aaf-aa2b-5a355331adbf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:44.909937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-afac61c9-83dc-4aaf-aa2b-5a355331adbf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:44.910684 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-afac61c9-83dc-4aaf-aa2b-5a355331adbf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:44.911709 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-afac61c9-83dc-4aaf-aa2b-5a355331adbf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:44.912506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-afac61c9-83dc-4aaf-aa2b-5a355331adbf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:45.023743 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-52593b54-8866-4996-9776-f0f71b2c994a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:45.060979 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-52593b54-8866-4996-9776-f0f71b2c994a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.473211 Jul 25 05:42:45.061641 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 295/595] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:44 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:45.072754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c0477e7d-2c02-43f0-a223-81746abcca82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:45.073408 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c0477e7d-2c02-43f0-a223-81746abcca82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:45.107730 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0477e7d-2c02-43f0-a223-81746abcca82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:45.108201 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0477e7d-2c02-43f0-a223-81746abcca82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:45.109053 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0477e7d-2c02-43f0-a223-81746abcca82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:45.109503 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0477e7d-2c02-43f0-a223-81746abcca82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:45.236136 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c0477e7d-2c02-43f0-a223-81746abcca82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:45.247970 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c0477e7d-2c02-43f0-a223-81746abcca82 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1226 microversion: 2.1 time: 0.182161 Jul 25 05:42:45.249179 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 296/596] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:45 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1226 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:45.254527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-afac61c9-83dc-4aaf-aa2b-5a355331adbf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:45.262363 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-afac61c9-83dc-4aaf-aa2b-5a355331adbf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.383545 Jul 25 05:42:45.262935 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 301/597] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:44 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:45.414066 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1597a59f-906a-4fc7-be1a-7abeb42448fa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:45.414608 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1597a59f-906a-4fc7-be1a-7abeb42448fa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:45.425250 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1597a59f-906a-4fc7-be1a-7abeb42448fa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:45.426896 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1597a59f-906a-4fc7-be1a-7abeb42448fa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:45.429780 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1597a59f-906a-4fc7-be1a-7abeb42448fa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:45.431791 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1597a59f-906a-4fc7-be1a-7abeb42448fa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:45.475712 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1597a59f-906a-4fc7-be1a-7abeb42448fa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:45.476498 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1597a59f-906a-4fc7-be1a-7abeb42448fa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:45.477221 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-1597a59f-906a-4fc7-be1a-7abeb42448fa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lazy-loading 'fault' on Instance uuid 4943e050-a915-4850-8e01-9590c5fcde77 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:42:45.554929 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1597a59f-906a-4fc7-be1a-7abeb42448fa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:45.576975 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1597a59f-906a-4fc7-be1a-7abeb42448fa tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 200 len: 1327 microversion: 2.1 time: 0.166793 Jul 25 05:42:45.577577 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 297/598] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:45 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 1327 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:45.869707 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-8383db0b-2f12-4a64-b810-b60b1c80ac5c req-25d198f8-6397-496d-9f02-ac60a6729484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fa910c-7604-4aa9-82ff-477d62f57f54", "name": "network-vif-deleted", "tag": "e15bc07d-1abd-455e-907e-fa844fbf01ce"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:45.880904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3133affa-ed7f-4d89-bd2a-014b9e47187a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:45.882372 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3133affa-ed7f-4d89-bd2a-014b9e47187a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] [instance: 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:45.914562 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-8383db0b-2f12-4a64-b810-b60b1c80ac5c req-25d198f8-6397-496d-9f02-ac60a6729484 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:45.915146 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3133affa-ed7f-4d89-bd2a-014b9e47187a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:45.915780 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-8383db0b-2f12-4a64-b810-b60b1c80ac5c req-25d198f8-6397-496d-9f02-ac60a6729484 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:45.916453 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3133affa-ed7f-4d89-bd2a-014b9e47187a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:45.920576 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3133affa-ed7f-4d89-bd2a-014b9e47187a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:45.924526 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3133affa-ed7f-4d89-bd2a-014b9e47187a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:45.955500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-8383db0b-2f12-4a64-b810-b60b1c80ac5c req-25d198f8-6397-496d-9f02-ac60a6729484 service nova] Creating event network-vif-deleted:e15bc07d-1abd-455e-907e-fa844fbf01ce for instance f6fa910c-7604-4aa9-82ff-477d62f57f54 on hv-cinder-85083 Jul 25 05:42:45.973622 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-3133affa-ed7f-4d89-bd2a-014b9e47187a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] HTTP exception thrown: Instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 could not be found. Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3133affa-ed7f-4d89-bd2a-014b9e47187a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Request method failure captured: Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 HTTP/1.1 Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iwGlH116eE9G9ee7Lm8JbUWiAPDu8YN3efd6rqcOJFGqiqIvx-Z4bkyaOgt73L_olv3J7RnJmzhVyekt9wWkZaL54kuiNpYanVEwj12N03q2Ucu7IGSA5oKP8wI9kg26x-Wl7rEFaGGhyw8DEAlUPLkVAIgJLPtlKNbsgMEc5Hn6Y8 Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: c782b01e8e484fe8bb710aeddc0192d1 Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:42:45.975304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c782b01e8e484fe8bb710aeddc0192d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c782b01e8e484fe8bb710aeddc0192d1"}]}] Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c782b01e8e484fe8bb710aeddc0192d1 Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1264352499 Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-ServerRescueNegativeTestJSON-1264352499-project Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 37c1bb8500f74013b073febfc0d96217 Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1264352499-project Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 could not be found. Jul 25 05:42:45.976581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '12aaf07a-d8f0-46c4-98f9-ba47ee257fa7'} Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 could not be found. Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:42:45.977377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 could not be found. Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 could not be found. Jul 25 05:42:45.978644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:42:45.981876 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3133affa-ed7f-4d89-bd2a-014b9e47187a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] Returning 404 to user: Instance 12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:42:45.981876 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3133affa-ed7f-4d89-bd2a-014b9e47187a tempest-ServerRescueNegativeTestJSON-1264352499 tempest-ServerRescueNegativeTestJSON-1264352499-project] 10.222.0.33 "GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7" status: 404 len: 111 microversion: 2.1 time: 0.103563 Jul 25 05:42:45.982090 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-8383db0b-2f12-4a64-b810-b60b1c80ac5c req-25d198f8-6397-496d-9f02-ac60a6729484 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116037 Jul 25 05:42:45.982090 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 302/599] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:45.982251 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 298/600] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:45 2022] GET /compute/v2.1/servers/12aaf07a-d8f0-46c4-98f9-ba47ee257fa7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 05:42:46.082224 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-41429f82-a925-482e-93bc-1519174854a9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:46.083676 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-41429f82-a925-482e-93bc-1519174854a9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:46.109763 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-41429f82-a925-482e-93bc-1519174854a9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:46.113088 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-41429f82-a925-482e-93bc-1519174854a9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:46.114849 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-41429f82-a925-482e-93bc-1519174854a9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:46.117003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-41429f82-a925-482e-93bc-1519174854a9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:46.267043 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-14b39f16-778e-404e-8953-b0982706364f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:46.268363 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-14b39f16-778e-404e-8953-b0982706364f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:46.286947 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14b39f16-778e-404e-8953-b0982706364f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:46.287407 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14b39f16-778e-404e-8953-b0982706364f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:46.290809 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14b39f16-778e-404e-8953-b0982706364f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:46.291472 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14b39f16-778e-404e-8953-b0982706364f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:46.370094 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14b39f16-778e-404e-8953-b0982706364f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:46.379759 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14b39f16-778e-404e-8953-b0982706364f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:46.380519 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-14b39f16-778e-404e-8953-b0982706364f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lazy-loading 'fault' on Instance uuid f6fa910c-7604-4aa9-82ff-477d62f57f54 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:42:46.520653 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-14b39f16-778e-404e-8953-b0982706364f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:46.562280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-14b39f16-778e-404e-8953-b0982706364f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 200 len: 1231 microversion: 2.1 time: 0.300219 Jul 25 05:42:46.572243 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 299/601] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:46 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 1231 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:46.600457 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c1fda80a-851c-4fe5-b2c5-b59750567bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:46.602837 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c1fda80a-851c-4fe5-b2c5-b59750567bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:46.638056 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c1fda80a-851c-4fe5-b2c5-b59750567bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:46.638529 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c1fda80a-851c-4fe5-b2c5-b59750567bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:46.645806 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c1fda80a-851c-4fe5-b2c5-b59750567bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:46.646286 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c1fda80a-851c-4fe5-b2c5-b59750567bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:46.670688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-41429f82-a925-482e-93bc-1519174854a9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:46.686342 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-41429f82-a925-482e-93bc-1519174854a9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.610074 Jul 25 05:42:46.691490 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 303/602] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:46 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:46.717230 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ada689a6-4ec4-4526-b2f9-7ede4d80b480 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:46.724411 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ada689a6-4ec4-4526-b2f9-7ede4d80b480 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:46.747846 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ada689a6-4ec4-4526-b2f9-7ede4d80b480 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:46.748346 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ada689a6-4ec4-4526-b2f9-7ede4d80b480 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:46.749428 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ada689a6-4ec4-4526-b2f9-7ede4d80b480 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:46.754849 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ada689a6-4ec4-4526-b2f9-7ede4d80b480 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:46.786264 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-ada689a6-4ec4-4526-b2f9-7ede4d80b480 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] HTTP exception thrown: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ada689a6-4ec4-4526-b2f9-7ede4d80b480 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Request method failure captured: Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 HTTP/1.1 Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3ixeU81EgFXlKh7Hp_fPTjofLKlA_grfgGFOsVR7V0Vy1Eew77MrsJvX_brgqZAZFs3_tH2uFzao_ltFj_e47Ammmd12lT7srFPlu7vMaHUNGiS21hpevq0t1NKjr51YZPl2StrqjfEMPMmxiZsJ-54lO9uorRvAHRoDHWZ2eZnZLfE Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:42:46.788248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0b7d41e75df46f28cebff70c16d4750"}]}] Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: c1ae82a1862048cb9038b7c76190da8a Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:42:46.789768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '4943e050-a915-4850-8e01-9590c5fcde77'} Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:42:46.790538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:42:46.791715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:46.796190 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ada689a6-4ec4-4526-b2f9-7ede4d80b480 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Returning 404 to user: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:42:46.797403 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ada689a6-4ec4-4526-b2f9-7ede4d80b480 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 404 len: 111 microversion: 2.1 time: 0.104310 Jul 25 05:42:46.798315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 304/603] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:46 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:42:46.808393 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3a75bdbe-87c8-4066-b40c-c749bccc3e00 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '.version_select at 0x7fcc845ae0d0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:46.840826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3a75bdbe-87c8-4066-b40c-c749bccc3e00 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124194878" status: 202 len: 0 microversion: 2.1 time: 0.037357 Jul 25 05:42:46.845616 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 305/604] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jul 25 05:42:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124194878 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:42:47.434070 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=12 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:47.593136 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b1c87677-b9bd-4e35-b575-e46e8e1b474e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:47.603649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b1c87677-b9bd-4e35-b575-e46e8e1b474e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:47.643523 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=2 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:47.646225 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=12 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:47.649991 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b1c87677-b9bd-4e35-b575-e46e8e1b474e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:47.650518 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b1c87677-b9bd-4e35-b575-e46e8e1b474e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:47.653203 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b1c87677-b9bd-4e35-b575-e46e8e1b474e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:47.657978 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b1c87677-b9bd-4e35-b575-e46e8e1b474e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:47.681041 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-b1c87677-b9bd-4e35-b575-e46e8e1b474e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] HTTP exception thrown: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b1c87677-b9bd-4e35-b575-e46e8e1b474e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Request method failure captured: Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 HTTP/1.1 Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iyM4iy7GPDLw_QaccoyiJV3b9PTWi1SldICPEtIzdbJYVB6XUnRKwbQ7T9i8_E2IJ_enYBppSBNkSNwVziotGPoqZQ5WHqiFZw4uMU3oUrr_w_9_KjBd2iPMtOFAY5RBp0QHK-fMVvRKr0oZH5_kxx6rJgIHSz44B8nL64lnA31fcY Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: ee638472255a48d2bdffa17a4ff22339 Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-TestVolumeBootPattern-301894717 Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:42:47.682957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ee638472255a48d2bdffa17a4ff22339"}]}] Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-TestVolumeBootPattern-301894717 Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: ee638472255a48d2bdffa17a4ff22339 Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-TestVolumeBootPattern-301894717 Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-TestVolumeBootPattern-301894717-project Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 1f815f111bf74739969736acea131927 Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-TestVolumeBootPattern-301894717-project Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:42:47.684657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': 'f6fa910c-7604-4aa9-82ff-477d62f57f54'} Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:42:47.685460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:42:47.687875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:42:47.698109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b1c87677-b9bd-4e35-b575-e46e8e1b474e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Returning 404 to user: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:42:47.699411 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b1c87677-b9bd-4e35-b575-e46e8e1b474e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 404 len: 111 microversion: 2.1 time: 0.113337 Jul 25 05:42:47.713538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 306/605] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:47 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 05:42:47.759155 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-faf5ebf9-d01e-415f-809e-e7eaa45c90dd tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:47.762301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-faf5ebf9-d01e-415f-809e-e7eaa45c90dd tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:47.770197 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-faf5ebf9-d01e-415f-809e-e7eaa45c90dd tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:47.770728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c1fda80a-851c-4fe5-b2c5-b59750567bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:47.771104 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-faf5ebf9-d01e-415f-809e-e7eaa45c90dd tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:47.772427 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-faf5ebf9-d01e-415f-809e-e7eaa45c90dd tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:47.773124 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-faf5ebf9-d01e-415f-809e-e7eaa45c90dd tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:47.779203 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c1fda80a-851c-4fe5-b2c5-b59750567bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 1.205049 Jul 25 05:42:47.784412 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 300/606] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:46 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:47.929789 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1465357225", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1985723475", "security_groups": [{"name": "tempest-secgroup-smoke-1677006254"}], "block_device_mapping_v2": [{"uuid": "d1831bcf-2454-46cb-a3f9-517659bc4f20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0bd65f0e-472c-4905-913d-3224424e7dac"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:48.152875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-faf5ebf9-d01e-415f-809e-e7eaa45c90dd tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:48.162799 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-faf5ebf9-d01e-415f-809e-e7eaa45c90dd tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.436648 Jul 25 05:42:48.168239 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 307/607] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:47 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:48.177682 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-abc982a5-6bd0-4b30-b4b6-a1517a16b181 req-45713e79-4622-4cc4-89ba-4f55782bada6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a30608a-b03b-41fb-95be-6ba3eba17562", "tag": "8a836452-7655-49c8-9aaf-c2441440165f"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:48.188268 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-abc982a5-6bd0-4b30-b4b6-a1517a16b181 req-45713e79-4622-4cc4-89ba-4f55782bada6 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:48.190365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-abc982a5-6bd0-4b30-b4b6-a1517a16b181 req-45713e79-4622-4cc4-89ba-4f55782bada6 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:48.207861 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-abc982a5-6bd0-4b30-b4b6-a1517a16b181 req-45713e79-4622-4cc4-89ba-4f55782bada6 service nova] Creating event network-changed:8a836452-7655-49c8-9aaf-c2441440165f for instance 5a30608a-b03b-41fb-95be-6ba3eba17562 on hv-cinder-85083 Jul 25 05:42:48.219074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-abc982a5-6bd0-4b30-b4b6-a1517a16b181 req-45713e79-4622-4cc4-89ba-4f55782bada6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045033 Jul 25 05:42:48.220955 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 308/608] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:48.275156 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] validate_networks() for [('0bd65f0e-472c-4905-913d-3224424e7dac', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:42:48.452191 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-23f3ae1c-0c22-4777-aee5-496e0d3c1cdc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Action: 'create', calling method: .version_select at 0x7fcc8450d790>, body: {"keypair": {"name": "tempest-keypair-127944121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaBuUIHIRvC8oBr4ky+1oz0xJ3i85dJ/V0THfqInbnkDeoP90Gi+v3twnyQTvjwaJvvRtluJ9svPe6elsn+6+EnRElUNNet7/X0phGJ4OvCCEyhgpPaB1Ckodcv1VEVUQ=="}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:48.482584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-23f3ae1c-0c22-4777-aee5-496e0d3c1cdc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Getting quotas for project f0b7d41e75df46f28cebff70c16d4750. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:42:48.490426 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-23f3ae1c-0c22-4777-aee5-496e0d3c1cdc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Getting quotas for user c1ae82a1862048cb9038b7c76190da8a and project f0b7d41e75df46f28cebff70c16d4750. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:42:48.557627 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-23f3ae1c-0c22-4777-aee5-496e0d3c1cdc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109639 Jul 25 05:42:48.558680 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 309/609] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 25 05:42:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:48.813016 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-798e7a0f-ba89-47f1-b595-b4a5bbfdc6f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:48.815278 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-798e7a0f-ba89-47f1-b595-b4a5bbfdc6f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:48.842697 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-798e7a0f-ba89-47f1-b595-b4a5bbfdc6f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:48.843414 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-798e7a0f-ba89-47f1-b595-b4a5bbfdc6f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:48.844201 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-798e7a0f-ba89-47f1-b595-b4a5bbfdc6f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:48.844808 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-798e7a0f-ba89-47f1-b595-b4a5bbfdc6f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:48.849658 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=100 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:49.357457 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:42:49.358212 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:42:49.358771 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:42:49.361201 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:42:49.361865 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:42:49.384469 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:49.385941 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:49.389426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:49.392526 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:49.414327 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-798e7a0f-ba89-47f1-b595-b4a5bbfdc6f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:49.432245 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-798e7a0f-ba89-47f1-b595-b4a5bbfdc6f9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.634458 Jul 25 05:42:49.433999 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 310/610] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:48 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:49.450946 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3f800940-5002-4efd-a1e4-2ed7e9442c0f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:49.451675 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3f800940-5002-4efd-a1e4-2ed7e9442c0f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:49.467502 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3f800940-5002-4efd-a1e4-2ed7e9442c0f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:49.468428 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3f800940-5002-4efd-a1e4-2ed7e9442c0f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:49.469466 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3f800940-5002-4efd-a1e4-2ed7e9442c0f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:49.471308 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3f800940-5002-4efd-a1e4-2ed7e9442c0f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:49.480280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Getting quotas for project ee638472255a48d2bdffa17a4ff22339. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:42:49.497316 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Getting quotas for user 1f815f111bf74739969736acea131927 and project ee638472255a48d2bdffa17a4ff22339. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:42:49.615200 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:42:49.621176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1831bcf-2454-46cb-a3f9-517659bc4f20',volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:42:50.002007 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-db8d2581-55ec-441a-a327-744a33bb1320 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.076234 Jul 25 05:42:50.003779 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 301/611] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:42:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 2079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:42:50.185788 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-d994e64f-e97d-44c3-83b3-5646da89e8c8 req-47bf818f-5ced-4b44-8825-bfb5454381c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9692b9-6007-40bf-80f1-a00b4a96d599", "name": "network-vif-plugged", "status": "completed", "tag": "dce542e4-936d-4f42-abff-da12f790ddc3"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:50.192611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3f800940-5002-4efd-a1e4-2ed7e9442c0f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:50.198824 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-d994e64f-e97d-44c3-83b3-5646da89e8c8 req-47bf818f-5ced-4b44-8825-bfb5454381c4 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:50.199822 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-d994e64f-e97d-44c3-83b3-5646da89e8c8 req-47bf818f-5ced-4b44-8825-bfb5454381c4 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:50.205291 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3f800940-5002-4efd-a1e4-2ed7e9442c0f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.765531 Jul 25 05:42:50.215056 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 311/612] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:49 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:50.221771 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f22788b4-d800-446c-acc4-ddc0897b4bb5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:50.224482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f22788b4-d800-446c-acc4-ddc0897b4bb5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:50.225218 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-d994e64f-e97d-44c3-83b3-5646da89e8c8 req-47bf818f-5ced-4b44-8825-bfb5454381c4 service nova] Creating event network-vif-plugged:dce542e4-936d-4f42-abff-da12f790ddc3 for instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 on hv-cinder-85083 Jul 25 05:42:50.231360 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-d994e64f-e97d-44c3-83b3-5646da89e8c8 req-47bf818f-5ced-4b44-8825-bfb5454381c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225081 Jul 25 05:42:50.232499 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 302/613] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:50.326352 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f22788b4-d800-446c-acc4-ddc0897b4bb5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:50.336318 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f22788b4-d800-446c-acc4-ddc0897b4bb5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1095 microversion: 2.1 time: 0.126716 Jul 25 05:42:50.339908 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 312/614] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:50 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1095 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:50.452327 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6c932af1-684a-4d40-9ffa-f943068f6914 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:50.454898 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6c932af1-684a-4d40-9ffa-f943068f6914 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:50.467001 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c932af1-684a-4d40-9ffa-f943068f6914 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:50.474886 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c932af1-684a-4d40-9ffa-f943068f6914 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:50.476531 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c932af1-684a-4d40-9ffa-f943068f6914 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:50.477168 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c932af1-684a-4d40-9ffa-f943068f6914 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:50.504183 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:50.848746 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6c932af1-684a-4d40-9ffa-f943068f6914 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:50.859641 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6c932af1-684a-4d40-9ffa-f943068f6914 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.411845 Jul 25 05:42:50.860639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 303/615] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:50 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:51.224973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4e33869f-35bf-4a8d-898f-4f0a005e79fe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:51.227024 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4e33869f-35bf-4a8d-898f-4f0a005e79fe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:51.245796 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e33869f-35bf-4a8d-898f-4f0a005e79fe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:51.249736 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e33869f-35bf-4a8d-898f-4f0a005e79fe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:51.251157 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e33869f-35bf-4a8d-898f-4f0a005e79fe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:51.251872 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e33869f-35bf-4a8d-898f-4f0a005e79fe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:51.359484 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9396cfda-1798-4175-a66b-55384534e981 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:51.360105 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9396cfda-1798-4175-a66b-55384534e981 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:51.382603 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9396cfda-1798-4175-a66b-55384534e981 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:51.383145 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9396cfda-1798-4175-a66b-55384534e981 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:51.386222 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9396cfda-1798-4175-a66b-55384534e981 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:51.386764 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9396cfda-1798-4175-a66b-55384534e981 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:51.731320 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9396cfda-1798-4175-a66b-55384534e981 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:51.763554 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9396cfda-1798-4175-a66b-55384534e981 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1145 microversion: 2.1 time: 0.406739 Jul 25 05:42:51.772868 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 304/616] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:51 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1145 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:51.848974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-863466320", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e8a2b36-0a33-4763-b71a-50bb1209bd57"}], "security_groups": [{"name": "tempest-securitygroup--432295991"}], "key_name": "tempest-keypair-127944121", "user_data": "}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:51.991481 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4e33869f-35bf-4a8d-898f-4f0a005e79fe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:52.004828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4e33869f-35bf-4a8d-898f-4f0a005e79fe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.786553 Jul 25 05:42:52.005912 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 313/617] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:51 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:52.014336 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-070fae94-0d38-40fb-9776-8427c9f7c25e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:52.015293 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-070fae94-0d38-40fb-9776-8427c9f7c25e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:52.036516 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-070fae94-0d38-40fb-9776-8427c9f7c25e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:52.037499 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-070fae94-0d38-40fb-9776-8427c9f7c25e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:52.038816 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-070fae94-0d38-40fb-9776-8427c9f7c25e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:52.039543 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-070fae94-0d38-40fb-9776-8427c9f7c25e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:52.070641 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] validate_networks() for [('9e8a2b36-0a33-4763-b71a-50bb1209bd57', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:42:52.670517 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-070fae94-0d38-40fb-9776-8427c9f7c25e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:52.678433 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-070fae94-0d38-40fb-9776-8427c9f7c25e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.670871 Jul 25 05:42:52.679004 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 314/618] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:52 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:52.785096 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e48c55a8-4070-4ce6-8515-3b4126eb435f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:52.785743 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e48c55a8-4070-4ce6-8515-3b4126eb435f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:52.793133 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e48c55a8-4070-4ce6-8515-3b4126eb435f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:52.793595 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e48c55a8-4070-4ce6-8515-3b4126eb435f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:52.794381 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e48c55a8-4070-4ce6-8515-3b4126eb435f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:52.794827 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e48c55a8-4070-4ce6-8515-3b4126eb435f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:52.966005 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e48c55a8-4070-4ce6-8515-3b4126eb435f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:52.979378 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e48c55a8-4070-4ce6-8515-3b4126eb435f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1193 microversion: 2.1 time: 0.196669 Jul 25 05:42:52.990962 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 315/619] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:52 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1193 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:53.024996 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b2b34f73-7c3d-4407-aa3b-fae038066438 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:53.026084 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b2b34f73-7c3d-4407-aa3b-fae038066438 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:53.037691 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b2b34f73-7c3d-4407-aa3b-fae038066438 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:53.038148 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b2b34f73-7c3d-4407-aa3b-fae038066438 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:53.039845 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b2b34f73-7c3d-4407-aa3b-fae038066438 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:53.041599 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b2b34f73-7c3d-4407-aa3b-fae038066438 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:53.266729 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:42:53.267864 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:42:53.268117 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:42:53.269113 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:42:53.270055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:42:53.281204 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:53.281959 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:53.283468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:53.284087 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:53.305269 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Getting quotas for project f0b7d41e75df46f28cebff70c16d4750. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:42:53.310386 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Getting quotas for user c1ae82a1862048cb9038b7c76190da8a and project f0b7d41e75df46f28cebff70c16d4750. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:42:53.326226 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:42:53.329606 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:42:53.335797 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b2b34f73-7c3d-4407-aa3b-fae038066438 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:53.346240 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b2b34f73-7c3d-4407-aa3b-fae038066438 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.325807 Jul 25 05:42:53.350503 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 316/620] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:53 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:53.368356 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:53.405225 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-dbf962d0-2fec-4861-9abb-f01bdfbe076c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.562907 Jul 25 05:42:53.414144 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 305/621] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:42:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:42:53.420738 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b8149d66-cf64-46cb-96c0-e0e22fef5775 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:53.421344 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b8149d66-cf64-46cb-96c0-e0e22fef5775 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:53.519965 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b8149d66-cf64-46cb-96c0-e0e22fef5775 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:53.529699 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b8149d66-cf64-46cb-96c0-e0e22fef5775 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1236 microversion: 2.1 time: 0.111762 Jul 25 05:42:53.542771 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 317/622] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:53 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1236 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:53.695861 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0e1210d4-6632-43e8-93bd-afa66be91b29 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:53.696712 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0e1210d4-6632-43e8-93bd-afa66be91b29 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:53.707934 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0e1210d4-6632-43e8-93bd-afa66be91b29 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:53.708448 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0e1210d4-6632-43e8-93bd-afa66be91b29 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:53.709281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0e1210d4-6632-43e8-93bd-afa66be91b29 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:53.710096 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0e1210d4-6632-43e8-93bd-afa66be91b29 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:53.949316 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0e1210d4-6632-43e8-93bd-afa66be91b29 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:53.957122 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0e1210d4-6632-43e8-93bd-afa66be91b29 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.265393 Jul 25 05:42:53.957754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 306/623] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:53 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:53.998065 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-79ad9aba-29fb-41a0-974b-17640379293f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:53.998685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-79ad9aba-29fb-41a0-974b-17640379293f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:54.005806 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-79ad9aba-29fb-41a0-974b-17640379293f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:54.006336 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-79ad9aba-29fb-41a0-974b-17640379293f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:54.007336 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-79ad9aba-29fb-41a0-974b-17640379293f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:54.007944 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-79ad9aba-29fb-41a0-974b-17640379293f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:54.078145 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-79ad9aba-29fb-41a0-974b-17640379293f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:54.091074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-79ad9aba-29fb-41a0-974b-17640379293f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1193 microversion: 2.1 time: 0.096538 Jul 25 05:42:54.102857 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 318/624] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:53 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1193 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:54.367134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b9ba2647-3432-4995-a9a4-08d20c462cbc tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:54.367757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b9ba2647-3432-4995-a9a4-08d20c462cbc tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:54.374575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b9ba2647-3432-4995-a9a4-08d20c462cbc tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:54.375251 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b9ba2647-3432-4995-a9a4-08d20c462cbc tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:54.377435 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b9ba2647-3432-4995-a9a4-08d20c462cbc tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:54.377953 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b9ba2647-3432-4995-a9a4-08d20c462cbc tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:54.525124 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b9ba2647-3432-4995-a9a4-08d20c462cbc tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:54.534393 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b9ba2647-3432-4995-a9a4-08d20c462cbc tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.170946 Jul 25 05:42:54.534988 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 307/625] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:54 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:54.549723 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-79d2679b-a37b-41a6-8efc-ee6f5a25725a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:54.550409 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-79d2679b-a37b-41a6-8efc-ee6f5a25725a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:54.557824 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-79d2679b-a37b-41a6-8efc-ee6f5a25725a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:54.558194 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-79d2679b-a37b-41a6-8efc-ee6f5a25725a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:54.558976 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-79d2679b-a37b-41a6-8efc-ee6f5a25725a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:54.559522 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-79d2679b-a37b-41a6-8efc-ee6f5a25725a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:54.649372 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-79d2679b-a37b-41a6-8efc-ee6f5a25725a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:54.660984 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-79d2679b-a37b-41a6-8efc-ee6f5a25725a tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1240 microversion: 2.1 time: 0.115770 Jul 25 05:42:54.662356 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 319/626] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:54 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1240 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:54.974295 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-47e51bc9-4b58-4160-9c8a-14a1cf5c89f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:54.975068 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-47e51bc9-4b58-4160-9c8a-14a1cf5c89f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:54.981108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-47e51bc9-4b58-4160-9c8a-14a1cf5c89f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:54.981570 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-47e51bc9-4b58-4160-9c8a-14a1cf5c89f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:54.982391 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-47e51bc9-4b58-4160-9c8a-14a1cf5c89f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:54.982900 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-47e51bc9-4b58-4160-9c8a-14a1cf5c89f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:55.108132 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-29018aa8-edd7-4095-b8cf-86bacd29d9fb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:55.109536 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-29018aa8-edd7-4095-b8cf-86bacd29d9fb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:55.116699 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-29018aa8-edd7-4095-b8cf-86bacd29d9fb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:55.117308 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-29018aa8-edd7-4095-b8cf-86bacd29d9fb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:55.118180 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-29018aa8-edd7-4095-b8cf-86bacd29d9fb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:55.118672 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-29018aa8-edd7-4095-b8cf-86bacd29d9fb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:55.119677 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-47e51bc9-4b58-4160-9c8a-14a1cf5c89f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:55.136581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-47e51bc9-4b58-4160-9c8a-14a1cf5c89f2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1368 microversion: 2.1 time: 0.166163 Jul 25 05:42:55.137816 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 308/627] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:54 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:55.206146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-29018aa8-edd7-4095-b8cf-86bacd29d9fb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:55.213836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-29018aa8-edd7-4095-b8cf-86bacd29d9fb tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1211 microversion: 2.1 time: 0.109535 Jul 25 05:42:55.214403 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 320/628] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:55 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:55.551379 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-48f9499e-1dad-4cce-ac56-6df24fb232ed tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:55.552137 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-48f9499e-1dad-4cce-ac56-6df24fb232ed tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:55.558778 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48f9499e-1dad-4cce-ac56-6df24fb232ed tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:55.559232 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48f9499e-1dad-4cce-ac56-6df24fb232ed tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:55.560003 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48f9499e-1dad-4cce-ac56-6df24fb232ed tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:55.560435 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48f9499e-1dad-4cce-ac56-6df24fb232ed tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:55.681256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-24bb08e2-f3af-4708-9528-4ca28457b948 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:55.682024 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-24bb08e2-f3af-4708-9528-4ca28457b948 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:55.693088 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-24bb08e2-f3af-4708-9528-4ca28457b948 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:55.697064 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-24bb08e2-f3af-4708-9528-4ca28457b948 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:55.697978 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-24bb08e2-f3af-4708-9528-4ca28457b948 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:55.699829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-24bb08e2-f3af-4708-9528-4ca28457b948 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:55.719990 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-48f9499e-1dad-4cce-ac56-6df24fb232ed tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:55.728508 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-48f9499e-1dad-4cce-ac56-6df24fb232ed tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.181587 Jul 25 05:42:55.730398 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 309/629] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:55 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:55.799898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-24bb08e2-f3af-4708-9528-4ca28457b948 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:55.807906 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-24bb08e2-f3af-4708-9528-4ca28457b948 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1232 microversion: 2.1 time: 0.132085 Jul 25 05:42:55.808823 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 321/630] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:55 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1232 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:56.155575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c834bfb9-8c1f-4860-a9b8-0a3371c36052 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:56.156203 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c834bfb9-8c1f-4860-a9b8-0a3371c36052 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:56.169929 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c834bfb9-8c1f-4860-a9b8-0a3371c36052 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:56.170393 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c834bfb9-8c1f-4860-a9b8-0a3371c36052 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:56.171172 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c834bfb9-8c1f-4860-a9b8-0a3371c36052 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:56.171654 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c834bfb9-8c1f-4860-a9b8-0a3371c36052 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:56.230955 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7b0efabe-7451-4307-b8e1-621a01172273 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:56.231579 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7b0efabe-7451-4307-b8e1-621a01172273 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:56.243093 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7b0efabe-7451-4307-b8e1-621a01172273 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:56.243556 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7b0efabe-7451-4307-b8e1-621a01172273 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:56.244543 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7b0efabe-7451-4307-b8e1-621a01172273 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:56.245020 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7b0efabe-7451-4307-b8e1-621a01172273 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:56.330362 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7b0efabe-7451-4307-b8e1-621a01172273 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:56.339802 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7b0efabe-7451-4307-b8e1-621a01172273 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1211 microversion: 2.1 time: 0.112429 Jul 25 05:42:56.352883 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 322/631] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:56 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:56.353250 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c834bfb9-8c1f-4860-a9b8-0a3371c36052 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:56.362080 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c834bfb9-8c1f-4860-a9b8-0a3371c36052 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1557 microversion: 2.1 time: 0.211164 Jul 25 05:42:56.363068 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 310/632] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:56 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:56.379538 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-90b43df0-156f-48a2-86cf-61f04b6c24ce tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:56.380035 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-90b43df0-156f-48a2-86cf-61f04b6c24ce tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:56.386097 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90b43df0-156f-48a2-86cf-61f04b6c24ce tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:56.386550 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90b43df0-156f-48a2-86cf-61f04b6c24ce tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:56.387307 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90b43df0-156f-48a2-86cf-61f04b6c24ce tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:56.387746 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-90b43df0-156f-48a2-86cf-61f04b6c24ce tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:56.526670 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-90b43df0-156f-48a2-86cf-61f04b6c24ce tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149429 Jul 25 05:42:56.527412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 323/633] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 25 05:42:56 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:42:56.747901 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-46daa93e-d5c2-4e6e-826b-2e1dce66736a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:56.748526 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-46daa93e-d5c2-4e6e-826b-2e1dce66736a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:56.757446 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46daa93e-d5c2-4e6e-826b-2e1dce66736a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:56.765682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46daa93e-d5c2-4e6e-826b-2e1dce66736a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:56.766726 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46daa93e-d5c2-4e6e-826b-2e1dce66736a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:56.767854 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46daa93e-d5c2-4e6e-826b-2e1dce66736a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:56.826271 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7288f1d2-7370-4aad-8d01-8fd60590e011 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:56.826883 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7288f1d2-7370-4aad-8d01-8fd60590e011 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:56.831137 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:42:56.846391 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7288f1d2-7370-4aad-8d01-8fd60590e011 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:56.846870 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7288f1d2-7370-4aad-8d01-8fd60590e011 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:56.850222 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7288f1d2-7370-4aad-8d01-8fd60590e011 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:56.851823 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7288f1d2-7370-4aad-8d01-8fd60590e011 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:56.969728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7288f1d2-7370-4aad-8d01-8fd60590e011 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:56.981458 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7288f1d2-7370-4aad-8d01-8fd60590e011 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1294 microversion: 2.1 time: 0.160175 Jul 25 05:42:56.994626 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 324/634] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:56 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1294 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:57.039320 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-46daa93e-d5c2-4e6e-826b-2e1dce66736a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:57.051985 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-46daa93e-d5c2-4e6e-826b-2e1dce66736a tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.309526 Jul 25 05:42:57.063157 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 311/635] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:56 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:57.359057 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ef252157-6797-4e31-8485-dd3a93c243e5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:57.360502 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ef252157-6797-4e31-8485-dd3a93c243e5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:57.378560 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ef252157-6797-4e31-8485-dd3a93c243e5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:57.379330 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ef252157-6797-4e31-8485-dd3a93c243e5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:57.380311 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ef252157-6797-4e31-8485-dd3a93c243e5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:57.381108 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ef252157-6797-4e31-8485-dd3a93c243e5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:57.695740 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ef252157-6797-4e31-8485-dd3a93c243e5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:57.706917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ef252157-6797-4e31-8485-dd3a93c243e5 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.352282 Jul 25 05:42:57.717551 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 325/636] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:57 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:58.002841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-13a7272e-3b97-46f3-8d70-d2e5d930f7b7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:58.003622 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-13a7272e-3b97-46f3-8d70-d2e5d930f7b7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:58.013681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-13a7272e-3b97-46f3-8d70-d2e5d930f7b7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:58.014708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-13a7272e-3b97-46f3-8d70-d2e5d930f7b7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:58.016394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-13a7272e-3b97-46f3-8d70-d2e5d930f7b7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:58.017045 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-13a7272e-3b97-46f3-8d70-d2e5d930f7b7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:58.069588 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-15ca5eb0-0594-4e51-a08d-1eb00a75bceb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:58.079509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-15ca5eb0-0594-4e51-a08d-1eb00a75bceb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:58.087082 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-15ca5eb0-0594-4e51-a08d-1eb00a75bceb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:58.087829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-15ca5eb0-0594-4e51-a08d-1eb00a75bceb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:58.088793 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-15ca5eb0-0594-4e51-a08d-1eb00a75bceb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:58.089444 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-15ca5eb0-0594-4e51-a08d-1eb00a75bceb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:58.115747 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-13a7272e-3b97-46f3-8d70-d2e5d930f7b7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:58.125371 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-13a7272e-3b97-46f3-8d70-d2e5d930f7b7 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1294 microversion: 2.1 time: 0.127764 Jul 25 05:42:58.126450 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 312/637] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:57 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1294 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:58.246138 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-15ca5eb0-0594-4e51-a08d-1eb00a75bceb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:58.255198 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-15ca5eb0-0594-4e51-a08d-1eb00a75bceb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.190075 Jul 25 05:42:58.268561 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 326/638] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:58 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:42:58.724539 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-18afef86-56c9-4429-9b6c-1c68e8023ced tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:58.725176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-18afef86-56c9-4429-9b6c-1c68e8023ced tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:58.731674 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-18afef86-56c9-4429-9b6c-1c68e8023ced tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:58.732456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-18afef86-56c9-4429-9b6c-1c68e8023ced tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:58.733985 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-18afef86-56c9-4429-9b6c-1c68e8023ced tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:58.734612 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-18afef86-56c9-4429-9b6c-1c68e8023ced tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:59.142686 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5083cade-92d7-4207-b007-0090c25e8c74 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:59.143488 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5083cade-92d7-4207-b007-0090c25e8c74 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:59.155818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5083cade-92d7-4207-b007-0090c25e8c74 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:59.156272 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5083cade-92d7-4207-b007-0090c25e8c74 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:59.157082 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5083cade-92d7-4207-b007-0090c25e8c74 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:59.157529 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5083cade-92d7-4207-b007-0090c25e8c74 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:59.491376 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-18afef86-56c9-4429-9b6c-1c68e8023ced tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:59.505181 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-18afef86-56c9-4429-9b6c-1c68e8023ced tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.784646 Jul 25 05:42:59.514651 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 313/639] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:58 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:59.520396 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-eaf1478d-d5d9-494f-bcce-e58f1598d8b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:42:59.535874 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-eaf1478d-d5d9-494f-bcce-e58f1598d8b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:42:59.542894 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eaf1478d-d5d9-494f-bcce-e58f1598d8b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:59.543579 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eaf1478d-d5d9-494f-bcce-e58f1598d8b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:59.544514 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eaf1478d-d5d9-494f-bcce-e58f1598d8b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:59.545140 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eaf1478d-d5d9-494f-bcce-e58f1598d8b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:59.816912 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5083cade-92d7-4207-b007-0090c25e8c74 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:59.825104 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5083cade-92d7-4207-b007-0090c25e8c74 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1361 microversion: 2.1 time: 0.686207 Jul 25 05:42:59.826013 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 327/640] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:59 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1361 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:59.831351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-505133c0-d18c-495b-a980-3a769c9aaf23 req-efeee62c-5e99-4959-9383-aea93291cb7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9692b9-6007-40bf-80f1-a00b4a96d599", "tag": "dce542e4-936d-4f42-abff-da12f790ddc3"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:59.849463 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-505133c0-d18c-495b-a980-3a769c9aaf23 req-efeee62c-5e99-4959-9383-aea93291cb7e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:59.850330 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-505133c0-d18c-495b-a980-3a769c9aaf23 req-efeee62c-5e99-4959-9383-aea93291cb7e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:59.877805 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-505133c0-d18c-495b-a980-3a769c9aaf23 req-efeee62c-5e99-4959-9383-aea93291cb7e service nova] Creating event network-changed:dce542e4-936d-4f42-abff-da12f790ddc3 for instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 on hv-cinder-85083 Jul 25 05:42:59.884337 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-505133c0-d18c-495b-a980-3a769c9aaf23 req-efeee62c-5e99-4959-9383-aea93291cb7e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056492 Jul 25 05:42:59.885399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 328/641] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:42:59.891175 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-f34102d8-9217-4bb1-83e6-4b055e4bd0be req-8407c4eb-28b8-46cf-8ff2-d4287b67d365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a30608a-b03b-41fb-95be-6ba3eba17562", "name": "network-vif-plugged", "status": "completed", "tag": "8a836452-7655-49c8-9aaf-c2441440165f"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:42:59.904395 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-f34102d8-9217-4bb1-83e6-4b055e4bd0be req-8407c4eb-28b8-46cf-8ff2-d4287b67d365 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:42:59.909903 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-f34102d8-9217-4bb1-83e6-4b055e4bd0be req-8407c4eb-28b8-46cf-8ff2-d4287b67d365 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:42:59.915048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-eaf1478d-d5d9-494f-bcce-e58f1598d8b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:42:59.923355 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-f34102d8-9217-4bb1-83e6-4b055e4bd0be req-8407c4eb-28b8-46cf-8ff2-d4287b67d365 service nova] Creating event network-vif-plugged:8a836452-7655-49c8-9aaf-c2441440165f for instance 5a30608a-b03b-41fb-95be-6ba3eba17562 on hv-cinder-85083 Jul 25 05:42:59.926350 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-eaf1478d-d5d9-494f-bcce-e58f1598d8b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.410270 Jul 25 05:42:59.927937 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 314/642] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:42:59 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:42:59.942714 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-f34102d8-9217-4bb1-83e6-4b055e4bd0be req-8407c4eb-28b8-46cf-8ff2-d4287b67d365 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055064 Jul 25 05:42:59.943640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 329/643] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:00.523397 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7e8597e6-0847-4279-a063-d9d02cc78a85 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:00.524010 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7e8597e6-0847-4279-a063-d9d02cc78a85 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:00.531956 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e8597e6-0847-4279-a063-d9d02cc78a85 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:00.541856 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e8597e6-0847-4279-a063-d9d02cc78a85 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:00.544477 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e8597e6-0847-4279-a063-d9d02cc78a85 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:00.547712 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e8597e6-0847-4279-a063-d9d02cc78a85 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:00.849014 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-49f524c7-cc77-4706-b7dd-e649c1c43282 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:00.850478 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-49f524c7-cc77-4706-b7dd-e649c1c43282 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:00.865353 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49f524c7-cc77-4706-b7dd-e649c1c43282 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:00.866116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49f524c7-cc77-4706-b7dd-e649c1c43282 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:00.868756 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49f524c7-cc77-4706-b7dd-e649c1c43282 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:00.870584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49f524c7-cc77-4706-b7dd-e649c1c43282 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:00.910297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=100 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:01.068912 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7e8597e6-0847-4279-a063-d9d02cc78a85 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:01.095447 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7e8597e6-0847-4279-a063-d9d02cc78a85 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.576480 Jul 25 05:43:01.099773 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 315/644] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:00 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:01.131679 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2156a987-fad1-47c8-a10c-0d588aeae753 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:01.133318 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2156a987-fad1-47c8-a10c-0d588aeae753 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:01.145784 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2156a987-fad1-47c8-a10c-0d588aeae753 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:01.146528 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2156a987-fad1-47c8-a10c-0d588aeae753 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:01.147680 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2156a987-fad1-47c8-a10c-0d588aeae753 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:01.148323 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2156a987-fad1-47c8-a10c-0d588aeae753 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:01.283923 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-49f524c7-cc77-4706-b7dd-e649c1c43282 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:01.294928 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-49f524c7-cc77-4706-b7dd-e649c1c43282 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1361 microversion: 2.1 time: 0.453697 Jul 25 05:43:01.296578 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 330/645] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:00 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1361 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:43:01.446649 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2156a987-fad1-47c8-a10c-0d588aeae753 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:01.456723 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2156a987-fad1-47c8-a10c-0d588aeae753 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1357 microversion: 2.1 time: 0.354470 Jul 25 05:43:01.457338 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 316/646] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:01 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1357 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:01.929617 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-ec241b8a-1396-411e-98ea-71f8d380fbe0 req-a236225f-57bd-41cb-87f4-53d0a7f38e6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc622d78-aba1-429a-8fe6-b3b0252bc63e", "tag": "b0866f27-ba8f-4546-9f9a-870e1b130663"}, {"name": "network-changed", "server_uuid": "4d3a0531-7a5e-4b9c-bb23-5079be9a101d", "tag": "7bfd86de-8081-4beb-baeb-694e95587519"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:01.946734 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-ec241b8a-1396-411e-98ea-71f8d380fbe0 req-a236225f-57bd-41cb-87f4-53d0a7f38e6e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:01.949132 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-ec241b8a-1396-411e-98ea-71f8d380fbe0 req-a236225f-57bd-41cb-87f4-53d0a7f38e6e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:01.975186 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-ec241b8a-1396-411e-98ea-71f8d380fbe0 req-a236225f-57bd-41cb-87f4-53d0a7f38e6e service nova] Creating event network-changed:b0866f27-ba8f-4546-9f9a-870e1b130663 for instance bc622d78-aba1-429a-8fe6-b3b0252bc63e on hv-cinder-85083 Jul 25 05:43:01.976015 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-ec241b8a-1396-411e-98ea-71f8d380fbe0 req-a236225f-57bd-41cb-87f4-53d0a7f38e6e service nova] Creating event network-changed:7bfd86de-8081-4beb-baeb-694e95587519 for instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d on hv-cinder-85083 Jul 25 05:43:01.984509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-ec241b8a-1396-411e-98ea-71f8d380fbe0 req-a236225f-57bd-41cb-87f4-53d0a7f38e6e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062229 Jul 25 05:43:01.989871 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 331/647] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:02.116559 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-aa88034f-7de1-44dd-bdde-adc6eaa27688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:02.118108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-aa88034f-7de1-44dd-bdde-adc6eaa27688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:02.125432 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa88034f-7de1-44dd-bdde-adc6eaa27688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:02.126497 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa88034f-7de1-44dd-bdde-adc6eaa27688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:02.128021 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa88034f-7de1-44dd-bdde-adc6eaa27688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:02.128560 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa88034f-7de1-44dd-bdde-adc6eaa27688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:02.318001 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5e58b318-c0bd-47cf-8488-7fcde9d0d8bc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:02.318801 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5e58b318-c0bd-47cf-8488-7fcde9d0d8bc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:02.327363 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5e58b318-c0bd-47cf-8488-7fcde9d0d8bc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:02.328295 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5e58b318-c0bd-47cf-8488-7fcde9d0d8bc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:02.329367 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5e58b318-c0bd-47cf-8488-7fcde9d0d8bc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:02.330102 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5e58b318-c0bd-47cf-8488-7fcde9d0d8bc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:02.433570 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa88034f-7de1-44dd-bdde-adc6eaa27688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:02.444610 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-aa88034f-7de1-44dd-bdde-adc6eaa27688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.332129 Jul 25 05:43:02.445930 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 317/648] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:02 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:02.474587 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1173cae9-8a39-47b8-bf8f-1e2ac2dcded9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:02.475857 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1173cae9-8a39-47b8-bf8f-1e2ac2dcded9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:02.482306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1173cae9-8a39-47b8-bf8f-1e2ac2dcded9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:02.483072 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1173cae9-8a39-47b8-bf8f-1e2ac2dcded9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:02.484073 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1173cae9-8a39-47b8-bf8f-1e2ac2dcded9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:02.484691 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1173cae9-8a39-47b8-bf8f-1e2ac2dcded9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:02.742404 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5e58b318-c0bd-47cf-8488-7fcde9d0d8bc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:02.768112 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5e58b318-c0bd-47cf-8488-7fcde9d0d8bc tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1361 microversion: 2.1 time: 0.458286 Jul 25 05:43:02.782446 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 332/649] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:02 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1361 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:43:02.944552 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1173cae9-8a39-47b8-bf8f-1e2ac2dcded9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:02.959065 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1173cae9-8a39-47b8-bf8f-1e2ac2dcded9 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1547 microversion: 2.1 time: 0.488376 Jul 25 05:43:02.972041 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 318/650] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:02 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1547 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:43:02.978827 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-75b17e3f-67f2-4b52-b62a-45f7e5be3bb5 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:02.980847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-75b17e3f-67f2-4b52-b62a-45f7e5be3bb5 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:02.989904 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-75b17e3f-67f2-4b52-b62a-45f7e5be3bb5 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:02.990749 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-75b17e3f-67f2-4b52-b62a-45f7e5be3bb5 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:02.991774 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-75b17e3f-67f2-4b52-b62a-45f7e5be3bb5 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:02.992430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-75b17e3f-67f2-4b52-b62a-45f7e5be3bb5 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:03.462364 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8216523b-26bc-4083-983d-e72458182f29 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:03.463602 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8216523b-26bc-4083-983d-e72458182f29 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:03.465923 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=4 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:03.466984 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=12 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:03.473404 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8216523b-26bc-4083-983d-e72458182f29 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:03.473864 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8216523b-26bc-4083-983d-e72458182f29 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:03.474647 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8216523b-26bc-4083-983d-e72458182f29 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:03.475094 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8216523b-26bc-4083-983d-e72458182f29 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:03.528853 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=8 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:03.568160 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-75b17e3f-67f2-4b52-b62a-45f7e5be3bb5 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:03.575586 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-75b17e3f-67f2-4b52-b62a-45f7e5be3bb5 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1547 microversion: 2.1 time: 0.601816 Jul 25 05:43:03.576465 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 333/651] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:02 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1547 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:03.594628 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cad267e1-c916-4b5d-8eb4-a6f1faa82d9d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:03.599054 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cad267e1-c916-4b5d-8eb4-a6f1faa82d9d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:03.599817 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-cad267e1-c916-4b5d-8eb4-a6f1faa82d9d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Searching by: {'deleted': False, 'project_id': '987ce20ceedd49cb9419cc506c50fce3'} {{(pid=124467) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 05:43:03.606791 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cad267e1-c916-4b5d-8eb4-a6f1faa82d9d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:03.607243 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cad267e1-c916-4b5d-8eb4-a6f1faa82d9d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:03.608063 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cad267e1-c916-4b5d-8eb4-a6f1faa82d9d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:03.608537 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cad267e1-c916-4b5d-8eb4-a6f1faa82d9d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:03.654031 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8216523b-26bc-4083-983d-e72458182f29 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:03.665128 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8216523b-26bc-4083-983d-e72458182f29 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.206603 Jul 25 05:43:03.666307 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 319/652] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:03 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:43:03.708329 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.multi_cell_list [None req-cad267e1-c916-4b5d-8eb4-a6f1faa82d9d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124467) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 05:43:03.793786 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-16e9efe5-fd53-440f-8894-b42b366f78ef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Action: 'create', calling method: .version_select at 0x7fcc843d5790>, body: {"keypair": {"name": "tempest-keypair-592229990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVbZU/YakXeLtGa0rK0UBgJVx6QyO05ATTMXmQLpLGEoTaDQCTQ0ExhEqIcon73ljvTDxzGHsvUgfebq7ufiZQudEDK0bCRB+H/d82/y9n5WvUh3AZF8I5pv8IN+3Zumw=="}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:03.802785 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cad267e1-c916-4b5d-8eb4-a6f1faa82d9d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213745 Jul 25 05:43:03.804892 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 334/653] 10.222.0.33 () {58 vars in 1124 bytes} [Mon Jul 25 05:43:03 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:03.807903 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-dafe0551-a394-445e-ba6f-9a6634984e11 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:03.808679 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-dafe0551-a394-445e-ba6f-9a6634984e11 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:03.814051 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-16e9efe5-fd53-440f-8894-b42b366f78ef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Getting quotas for project 07879d074bee4b36b1f2f661dc4aeb7f. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:43:03.815258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dafe0551-a394-445e-ba6f-9a6634984e11 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:03.815907 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dafe0551-a394-445e-ba6f-9a6634984e11 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:03.816684 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dafe0551-a394-445e-ba6f-9a6634984e11 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:03.817174 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dafe0551-a394-445e-ba6f-9a6634984e11 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:03.818765 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-16e9efe5-fd53-440f-8894-b42b366f78ef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Getting quotas for user 6973623dc52c402ab51dbf1a7169d3e9 and project 07879d074bee4b36b1f2f661dc4aeb7f. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:43:03.842044 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-16e9efe5-fd53-440f-8894-b42b366f78ef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.163771 Jul 25 05:43:03.849269 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 320/654] 10.222.0.33 () {62 vars in 1199 bytes} [Mon Jul 25 05:43:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 05:43:03.856583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2962a72e-1616-4adc-b04a-a1eeef408490 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:03.857231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2962a72e-1616-4adc-b04a-a1eeef408490 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:03.864278 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2962a72e-1616-4adc-b04a-a1eeef408490 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:03.864744 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2962a72e-1616-4adc-b04a-a1eeef408490 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:03.865592 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2962a72e-1616-4adc-b04a-a1eeef408490 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:03.866008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2962a72e-1616-4adc-b04a-a1eeef408490 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:04.039287 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-dafe0551-a394-445e-ba6f-9a6634984e11 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:04.050504 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-dafe0551-a394-445e-ba6f-9a6634984e11 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1361 microversion: 2.1 time: 0.245784 Jul 25 05:43:04.051209 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 335/655] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:03 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:04.063220 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2962a72e-1616-4adc-b04a-a1eeef408490 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:04.065906 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:04.072924 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2962a72e-1616-4adc-b04a-a1eeef408490 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1547 microversion: 2.1 time: 0.228246 Jul 25 05:43:04.073541 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 321/656] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:03 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1547 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:04.683168 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ed0e580f-31d2-4f0a-bcbe-463d5dd1e87c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:04.683816 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ed0e580f-31d2-4f0a-bcbe-463d5dd1e87c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:04.692732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ed0e580f-31d2-4f0a-bcbe-463d5dd1e87c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:04.693524 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ed0e580f-31d2-4f0a-bcbe-463d5dd1e87c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:04.695124 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ed0e580f-31d2-4f0a-bcbe-463d5dd1e87c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:04.695794 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ed0e580f-31d2-4f0a-bcbe-463d5dd1e87c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:04.892199 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ed0e580f-31d2-4f0a-bcbe-463d5dd1e87c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:04.906895 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ed0e580f-31d2-4f0a-bcbe-463d5dd1e87c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.221924 Jul 25 05:43:04.908300 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 336/657] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:04 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:05.067461 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-01c37897-8129-4b93-8a1d-a30452686fd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:05.068828 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-01c37897-8129-4b93-8a1d-a30452686fd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:05.076009 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01c37897-8129-4b93-8a1d-a30452686fd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:05.076453 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01c37897-8129-4b93-8a1d-a30452686fd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:05.077424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01c37897-8129-4b93-8a1d-a30452686fd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:05.078020 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01c37897-8129-4b93-8a1d-a30452686fd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:05.313363 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-01c37897-8129-4b93-8a1d-a30452686fd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:05.328222 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-01c37897-8129-4b93-8a1d-a30452686fd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1361 microversion: 2.1 time: 0.264428 Jul 25 05:43:05.333345 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 322/658] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:05 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:05.553931 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-775299482", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3bf226e-5490-492a-a2d4-f65b0aace87c"}], "security_groups": [{"name": "tempest-securitygroup--1141492731"}], "key_name": "tempest-keypair-592229990", "user_data": "}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:05.715020 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.network.neutron [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] validate_networks() for [('a3bf226e-5490-492a-a2d4-f65b0aace87c', None, None, None, None, None)] {{(pid=124467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:43:05.822684 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-27d06bd4-1d4d-45b3-aea0-8a33b7f348df tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd34110a-3bc3-4cdf-b5d7-cc87757f7e86"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:05.824131 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-27d06bd4-1d4d-45b3-aea0-8a33b7f348df tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:05.834137 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27d06bd4-1d4d-45b3-aea0-8a33b7f348df tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:05.834602 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27d06bd4-1d4d-45b3-aea0-8a33b7f348df tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:05.835568 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27d06bd4-1d4d-45b3-aea0-8a33b7f348df tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:05.836562 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-27d06bd4-1d4d-45b3-aea0-8a33b7f348df tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:06.222687 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-27d06bd4-1d4d-45b3-aea0-8a33b7f348df tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "POST /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403906 Jul 25 05:43:06.241917 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 323/659] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:43:05 2022] POST /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:43:06.259060 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f565951a-14a9-4102-ab83-3d71a6dd84dc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:06.259745 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f565951a-14a9-4102-ab83-3d71a6dd84dc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:06.269121 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f565951a-14a9-4102-ab83-3d71a6dd84dc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:06.269931 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f565951a-14a9-4102-ab83-3d71a6dd84dc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:06.277366 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f565951a-14a9-4102-ab83-3d71a6dd84dc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:06.278084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f565951a-14a9-4102-ab83-3d71a6dd84dc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:06.396844 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Flavor limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:43:06.397584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Image limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:43:06.398544 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Flavor pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:43:06.399463 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Image pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:43:06.400038 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:43:06.413320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:06.414114 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:06.415557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:06.416186 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:06.448252 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Getting quotas for project 07879d074bee4b36b1f2f661dc4aeb7f. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:43:06.453370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Getting quotas for user 6973623dc52c402ab51dbf1a7169d3e9 and project 07879d074bee4b36b1f2f661dc4aeb7f. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:43:06.471891 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Going to run 1 instances... {{(pid=124467) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:43:06.474290 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:43:06.479642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f565951a-14a9-4102-ab83-3d71a6dd84dc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:06.495383 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f565951a-14a9-4102-ab83-3d71a6dd84dc tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.247884 Jul 25 05:43:06.496327 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 324/660] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:06 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:06.502530 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fa9fa850-f98b-4487-8ffa-d8652c8e935b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:06.503135 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fa9fa850-f98b-4487-8ffa-d8652c8e935b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:06.510723 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa9fa850-f98b-4487-8ffa-d8652c8e935b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:06.511105 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa9fa850-f98b-4487-8ffa-d8652c8e935b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:06.512059 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa9fa850-f98b-4487-8ffa-d8652c8e935b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:06.512510 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa9fa850-f98b-4487-8ffa-d8652c8e935b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:06.526627 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6b7a4c6e-f472-4049-8728-0055e6df1ba9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.977852 Jul 25 05:43:06.527819 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 337/661] 10.222.0.33 () {62 vars in 1187 bytes} [Mon Jul 25 05:43:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 05:43:06.540700 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9f114b0e-fd59-4a86-bc77-335e08013e7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:06.541040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-9f114b0e-fd59-4a86-bc77-335e08013e7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:06.648619 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9f114b0e-fd59-4a86-bc77-335e08013e7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:06.669589 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9f114b0e-fd59-4a86-bc77-335e08013e7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:06.681829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9f114b0e-fd59-4a86-bc77-335e08013e7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:06.683284 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-9f114b0e-fd59-4a86-bc77-335e08013e7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1280 microversion: 2.20 time: 0.147659 Jul 25 05:43:06.685830 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 338/662] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:43:06 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1280 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:43:06.755788 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fa9fa850-f98b-4487-8ffa-d8652c8e935b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:06.765226 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fa9fa850-f98b-4487-8ffa-d8652c8e935b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1361 microversion: 2.1 time: 0.267597 Jul 25 05:43:06.765736 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 325/663] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:06 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:07.092588 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-4cd0cb8b-98fb-4cc7-92e6-0675dffdbf45 req-2fe45f22-05c0-404a-a4fd-9f8f34217367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3a0531-7a5e-4b9c-bb23-5079be9a101d", "name": "network-vif-plugged", "status": "completed", "tag": "7bfd86de-8081-4beb-baeb-694e95587519"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:07.108959 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-4cd0cb8b-98fb-4cc7-92e6-0675dffdbf45 req-2fe45f22-05c0-404a-a4fd-9f8f34217367 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:07.109413 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-4cd0cb8b-98fb-4cc7-92e6-0675dffdbf45 req-2fe45f22-05c0-404a-a4fd-9f8f34217367 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:07.125988 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-4cd0cb8b-98fb-4cc7-92e6-0675dffdbf45 req-2fe45f22-05c0-404a-a4fd-9f8f34217367 service nova] Creating event network-vif-plugged:7bfd86de-8081-4beb-baeb-694e95587519 for instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d on hv-cinder-85083 Jul 25 05:43:07.132075 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-4cd0cb8b-98fb-4cc7-92e6-0675dffdbf45 req-2fe45f22-05c0-404a-a4fd-9f8f34217367 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043533 Jul 25 05:43:07.133861 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 339/664] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:43:07.514451 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-10f54e1b-79aa-4367-aaf2-bcceb8495621 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:07.515059 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-10f54e1b-79aa-4367-aaf2-bcceb8495621 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:07.522384 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-10f54e1b-79aa-4367-aaf2-bcceb8495621 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:07.522837 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-10f54e1b-79aa-4367-aaf2-bcceb8495621 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:07.523590 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-10f54e1b-79aa-4367-aaf2-bcceb8495621 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:07.524028 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-10f54e1b-79aa-4367-aaf2-bcceb8495621 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:07.656498 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-10f54e1b-79aa-4367-aaf2-bcceb8495621 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:07.663974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-10f54e1b-79aa-4367-aaf2-bcceb8495621 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.153396 Jul 25 05:43:07.664531 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 326/665] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:07 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:07.706012 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1f467ccb-99bf-450b-b476-106bd6b45670 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:07.706702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1f467ccb-99bf-450b-b476-106bd6b45670 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:07.713291 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1f467ccb-99bf-450b-b476-106bd6b45670 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:07.713733 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1f467ccb-99bf-450b-b476-106bd6b45670 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:07.714480 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1f467ccb-99bf-450b-b476-106bd6b45670 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:07.714917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1f467ccb-99bf-450b-b476-106bd6b45670 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:07.778014 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1f467ccb-99bf-450b-b476-106bd6b45670 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:07.784601 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f3abb19f-613d-4a16-8266-fec6751c8d23 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:07.785259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f3abb19f-613d-4a16-8266-fec6751c8d23 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:07.786935 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1f467ccb-99bf-450b-b476-106bd6b45670 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:07.788511 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1f467ccb-99bf-450b-b476-106bd6b45670 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:07.789633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1f467ccb-99bf-450b-b476-106bd6b45670 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1276 microversion: 2.20 time: 0.087986 Jul 25 05:43:07.790177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 340/666] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:43:07 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:43:07.791123 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3abb19f-613d-4a16-8266-fec6751c8d23 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:07.791580 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3abb19f-613d-4a16-8266-fec6751c8d23 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:07.792354 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3abb19f-613d-4a16-8266-fec6751c8d23 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:07.792836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3abb19f-613d-4a16-8266-fec6751c8d23 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:07.927217 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f3abb19f-613d-4a16-8266-fec6751c8d23 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:07.934440 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f3abb19f-613d-4a16-8266-fec6751c8d23 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1361 microversion: 2.1 time: 0.154706 Jul 25 05:43:07.935005 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 327/667] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:07 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:43:08.681215 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-464ddc00-4149-48b7-b201-e2d16f6144e8 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:08.681824 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-464ddc00-4149-48b7-b201-e2d16f6144e8 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:08.687950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-464ddc00-4149-48b7-b201-e2d16f6144e8 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:08.688395 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-464ddc00-4149-48b7-b201-e2d16f6144e8 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:08.689174 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-464ddc00-4149-48b7-b201-e2d16f6144e8 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:08.690265 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-464ddc00-4149-48b7-b201-e2d16f6144e8 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:08.809933 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5e40ee3f-ca72-4c01-bc04-e8eb860bef22 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:08.810694 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5e40ee3f-ca72-4c01-bc04-e8eb860bef22 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:08.821240 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e40ee3f-ca72-4c01-bc04-e8eb860bef22 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:08.821830 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e40ee3f-ca72-4c01-bc04-e8eb860bef22 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:08.822709 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e40ee3f-ca72-4c01-bc04-e8eb860bef22 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:08.823246 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e40ee3f-ca72-4c01-bc04-e8eb860bef22 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:08.825022 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-464ddc00-4149-48b7-b201-e2d16f6144e8 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:08.834122 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-464ddc00-4149-48b7-b201-e2d16f6144e8 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.156638 Jul 25 05:43:08.835892 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 341/668] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:08 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:08.933902 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5e40ee3f-ca72-4c01-bc04-e8eb860bef22 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:08.942185 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5e40ee3f-ca72-4c01-bc04-e8eb860bef22 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:08.943795 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5e40ee3f-ca72-4c01-bc04-e8eb860bef22 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:08.945162 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5e40ee3f-ca72-4c01-bc04-e8eb860bef22 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1340 microversion: 2.20 time: 0.140686 Jul 25 05:43:08.953753 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 328/669] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:43:08 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1340 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:43:08.960129 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9093cf9d-8e27-4832-9340-db6697913d4e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:08.961237 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-9093cf9d-8e27-4832-9340-db6697913d4e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:08.967507 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9093cf9d-8e27-4832-9340-db6697913d4e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:08.967961 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9093cf9d-8e27-4832-9340-db6697913d4e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:08.968721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9093cf9d-8e27-4832-9340-db6697913d4e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:08.969447 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9093cf9d-8e27-4832-9340-db6697913d4e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:09.108668 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9093cf9d-8e27-4832-9340-db6697913d4e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:09.117433 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-9093cf9d-8e27-4832-9340-db6697913d4e tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1361 microversion: 2.1 time: 0.161055 Jul 25 05:43:09.118077 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 342/670] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:08 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:09.911742 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-939a7a28-2cfb-4953-a7aa-5d16982601ff tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:09.912370 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-939a7a28-2cfb-4953-a7aa-5d16982601ff tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:09.919394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-939a7a28-2cfb-4953-a7aa-5d16982601ff tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:09.919851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-939a7a28-2cfb-4953-a7aa-5d16982601ff tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:09.920631 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-939a7a28-2cfb-4953-a7aa-5d16982601ff tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:09.921101 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-939a7a28-2cfb-4953-a7aa-5d16982601ff tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:09.964144 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4e2ba2b4-2ecc-4eb0-8883-62207f1bae70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:09.964925 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4e2ba2b4-2ecc-4eb0-8883-62207f1bae70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:09.972539 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e2ba2b4-2ecc-4eb0-8883-62207f1bae70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:09.973260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e2ba2b4-2ecc-4eb0-8883-62207f1bae70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:09.974265 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e2ba2b4-2ecc-4eb0-8883-62207f1bae70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:09.974769 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e2ba2b4-2ecc-4eb0-8883-62207f1bae70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:10.112651 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-939a7a28-2cfb-4953-a7aa-5d16982601ff tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:10.120170 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-939a7a28-2cfb-4953-a7aa-5d16982601ff tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.212456 Jul 25 05:43:10.120742 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 329/671] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:09 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:43:10.134102 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-88e9fb60-2559-4d8b-99e4-80b4ce6ae5c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:10.134715 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-88e9fb60-2559-4d8b-99e4-80b4ce6ae5c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:10.142171 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88e9fb60-2559-4d8b-99e4-80b4ce6ae5c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:10.142306 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4e2ba2b4-2ecc-4eb0-8883-62207f1bae70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:10.143282 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88e9fb60-2559-4d8b-99e4-80b4ce6ae5c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:10.144651 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88e9fb60-2559-4d8b-99e4-80b4ce6ae5c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:10.145374 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88e9fb60-2559-4d8b-99e4-80b4ce6ae5c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:10.160585 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4e2ba2b4-2ecc-4eb0-8883-62207f1bae70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:10.162440 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4e2ba2b4-2ecc-4eb0-8883-62207f1bae70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:10.164509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4e2ba2b4-2ecc-4eb0-8883-62207f1bae70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1406 microversion: 2.20 time: 0.204544 Jul 25 05:43:10.168368 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 343/672] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:43:09 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:43:10.292739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-88e9fb60-2559-4d8b-99e4-80b4ce6ae5c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:10.301063 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-88e9fb60-2559-4d8b-99e4-80b4ce6ae5c9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1361 microversion: 2.1 time: 0.170622 Jul 25 05:43:10.301852 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 330/673] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:10 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:43:10.788037 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-ad2677c4-5521-410a-b35f-6568e2008b23 req-16828995-b941-4e74-8216-e0f697e42e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb16475-6c9b-4c00-be15-0b5f68b01d0a", "tag": "15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:10.813334 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-ad2677c4-5521-410a-b35f-6568e2008b23 req-16828995-b941-4e74-8216-e0f697e42e02 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:10.813861 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-ad2677c4-5521-410a-b35f-6568e2008b23 req-16828995-b941-4e74-8216-e0f697e42e02 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:10.827480 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-ad2677c4-5521-410a-b35f-6568e2008b23 req-16828995-b941-4e74-8216-e0f697e42e02 service nova] Creating event network-changed:15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc for instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a on hv-cinder-85083 Jul 25 05:43:10.833384 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-ad2677c4-5521-410a-b35f-6568e2008b23 req-16828995-b941-4e74-8216-e0f697e42e02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048881 Jul 25 05:43:10.833989 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 344/674] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:11.100768 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-d72db601-1db4-4363-8bf9-9cee4dd5e396 req-c540c289-7564-449e-a636-cf0e9d861257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc622d78-aba1-429a-8fe6-b3b0252bc63e", "name": "network-vif-plugged", "status": "completed", "tag": "b0866f27-ba8f-4546-9f9a-870e1b130663"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:11.110951 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-d72db601-1db4-4363-8bf9-9cee4dd5e396 req-c540c289-7564-449e-a636-cf0e9d861257 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:11.112417 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-d72db601-1db4-4363-8bf9-9cee4dd5e396 req-c540c289-7564-449e-a636-cf0e9d861257 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:11.124194 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-d72db601-1db4-4363-8bf9-9cee4dd5e396 req-c540c289-7564-449e-a636-cf0e9d861257 service nova] Creating event network-vif-plugged:b0866f27-ba8f-4546-9f9a-870e1b130663 for instance bc622d78-aba1-429a-8fe6-b3b0252bc63e on hv-cinder-85083 Jul 25 05:43:11.132192 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-d72db601-1db4-4363-8bf9-9cee4dd5e396 req-c540c289-7564-449e-a636-cf0e9d861257 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034822 Jul 25 05:43:11.134190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 331/675] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:11.139798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-49ae05c1-c3a5-478e-8dfe-50d889e23c5a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:11.141121 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-49ae05c1-c3a5-478e-8dfe-50d889e23c5a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:11.149811 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49ae05c1-c3a5-478e-8dfe-50d889e23c5a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:11.150271 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49ae05c1-c3a5-478e-8dfe-50d889e23c5a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:11.151075 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49ae05c1-c3a5-478e-8dfe-50d889e23c5a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:11.151908 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49ae05c1-c3a5-478e-8dfe-50d889e23c5a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:11.187678 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e28a9f52-fed6-4dac-98b2-e22e767d0eb1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:11.188773 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e28a9f52-fed6-4dac-98b2-e22e767d0eb1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:11.197941 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e28a9f52-fed6-4dac-98b2-e22e767d0eb1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:11.198647 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e28a9f52-fed6-4dac-98b2-e22e767d0eb1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:11.199984 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e28a9f52-fed6-4dac-98b2-e22e767d0eb1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:11.200427 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e28a9f52-fed6-4dac-98b2-e22e767d0eb1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:11.343885 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-49ae05c1-c3a5-478e-8dfe-50d889e23c5a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:11.353040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-49ae05c1-c3a5-478e-8dfe-50d889e23c5a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.218917 Jul 25 05:43:11.363461 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 345/676] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:11 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:11.368934 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7d51e795-c134-43b4-943d-cb17e0165a05 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:11.369774 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7d51e795-c134-43b4-943d-cb17e0165a05 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:11.378218 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7d51e795-c134-43b4-943d-cb17e0165a05 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:11.378915 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7d51e795-c134-43b4-943d-cb17e0165a05 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:11.379862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7d51e795-c134-43b4-943d-cb17e0165a05 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:11.380685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7d51e795-c134-43b4-943d-cb17e0165a05 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:11.387264 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e28a9f52-fed6-4dac-98b2-e22e767d0eb1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:11.398262 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e28a9f52-fed6-4dac-98b2-e22e767d0eb1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:11.399807 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e28a9f52-fed6-4dac-98b2-e22e767d0eb1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:11.400992 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e28a9f52-fed6-4dac-98b2-e22e767d0eb1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1406 microversion: 2.20 time: 0.218742 Jul 25 05:43:11.401557 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 332/677] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:43:11 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:43:11.525528 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7d51e795-c134-43b4-943d-cb17e0165a05 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:11.532878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7d51e795-c134-43b4-943d-cb17e0165a05 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1546 microversion: 2.1 time: 0.167860 Jul 25 05:43:11.534010 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 346/678] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:11 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:11.550464 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e6ed373d-69a6-4d41-860b-2667ef3b7e2f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:11.550963 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e6ed373d-69a6-4d41-860b-2667ef3b7e2f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:11.557051 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6ed373d-69a6-4d41-860b-2667ef3b7e2f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:11.557511 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6ed373d-69a6-4d41-860b-2667ef3b7e2f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:11.558286 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6ed373d-69a6-4d41-860b-2667ef3b7e2f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:11.558729 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6ed373d-69a6-4d41-860b-2667ef3b7e2f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:11.639657 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e6ed373d-69a6-4d41-860b-2667ef3b7e2f tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093544 Jul 25 05:43:11.640244 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 333/679] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 25 05:43:11 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:12.370267 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-052cd1f6-3bcb-41ae-b01b-5d73772c8f3d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:12.371025 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-052cd1f6-3bcb-41ae-b01b-5d73772c8f3d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:12.377632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-052cd1f6-3bcb-41ae-b01b-5d73772c8f3d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:12.378087 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-052cd1f6-3bcb-41ae-b01b-5d73772c8f3d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:12.378865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-052cd1f6-3bcb-41ae-b01b-5d73772c8f3d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:12.379315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-052cd1f6-3bcb-41ae-b01b-5d73772c8f3d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:12.420586 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-014c8d40-0f7a-46d5-842e-b8eb412db89b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:12.421250 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-014c8d40-0f7a-46d5-842e-b8eb412db89b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:12.427623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-014c8d40-0f7a-46d5-842e-b8eb412db89b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:12.428086 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-014c8d40-0f7a-46d5-842e-b8eb412db89b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:12.428893 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-014c8d40-0f7a-46d5-842e-b8eb412db89b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:12.429340 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-014c8d40-0f7a-46d5-842e-b8eb412db89b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:12.661316 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-052cd1f6-3bcb-41ae-b01b-5d73772c8f3d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:12.668710 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-052cd1f6-3bcb-41ae-b01b-5d73772c8f3d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.302271 Jul 25 05:43:12.669366 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 347/680] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:12 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:12.716921 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-014c8d40-0f7a-46d5-842e-b8eb412db89b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:12.728821 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-014c8d40-0f7a-46d5-842e-b8eb412db89b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:12.730563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-014c8d40-0f7a-46d5-842e-b8eb412db89b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:12.731673 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-014c8d40-0f7a-46d5-842e-b8eb412db89b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1406 microversion: 2.20 time: 0.315538 Jul 25 05:43:12.732711 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-48d5fa7f-c9d1-4dc9-b325-2c1965a9bb08 req-f2923b29-2f59-45f0-8ea7-aed6fcd56a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d3a0531-7a5e-4b9c-bb23-5079be9a101d", "tag": "7bfd86de-8081-4beb-baeb-694e95587519"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:12.736880 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 334/681] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:43:12 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:43:12.740897 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-48d5fa7f-c9d1-4dc9-b325-2c1965a9bb08 req-f2923b29-2f59-45f0-8ea7-aed6fcd56a7b service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:12.741354 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-48d5fa7f-c9d1-4dc9-b325-2c1965a9bb08 req-f2923b29-2f59-45f0-8ea7-aed6fcd56a7b service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:12.752615 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-48d5fa7f-c9d1-4dc9-b325-2c1965a9bb08 req-f2923b29-2f59-45f0-8ea7-aed6fcd56a7b service nova] Creating event network-changed:7bfd86de-8081-4beb-baeb-694e95587519 for instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d on hv-cinder-85083 Jul 25 05:43:12.757496 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-48d5fa7f-c9d1-4dc9-b325-2c1965a9bb08 req-f2923b29-2f59-45f0-8ea7-aed6fcd56a7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028328 Jul 25 05:43:12.758094 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 348/682] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:43:13.687385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-eefe7d91-7a1b-4d45-b809-1a1beae84688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:13.688154 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-eefe7d91-7a1b-4d45-b809-1a1beae84688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:13.697677 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eefe7d91-7a1b-4d45-b809-1a1beae84688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:13.699344 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eefe7d91-7a1b-4d45-b809-1a1beae84688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:13.700135 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eefe7d91-7a1b-4d45-b809-1a1beae84688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:13.700583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eefe7d91-7a1b-4d45-b809-1a1beae84688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:13.751146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3318f668-9611-41e8-a364-4d1106e86e96 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:13.751862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3318f668-9611-41e8-a364-4d1106e86e96 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:13.760313 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3318f668-9611-41e8-a364-4d1106e86e96 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:13.760803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3318f668-9611-41e8-a364-4d1106e86e96 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:13.761584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3318f668-9611-41e8-a364-4d1106e86e96 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:13.762028 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3318f668-9611-41e8-a364-4d1106e86e96 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:13.830112 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=4 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:13.942612 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-eefe7d91-7a1b-4d45-b809-1a1beae84688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:13.951426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-eefe7d91-7a1b-4d45-b809-1a1beae84688 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1267 microversion: 2.1 time: 0.268267 Jul 25 05:43:13.952961 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 335/683] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:13 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:13.964802 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3318f668-9611-41e8-a364-4d1106e86e96 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:13.974568 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3318f668-9611-41e8-a364-4d1106e86e96 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:13.976085 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3318f668-9611-41e8-a364-4d1106e86e96 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:13.977435 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3318f668-9611-41e8-a364-4d1106e86e96 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1406 microversion: 2.20 time: 0.231322 Jul 25 05:43:13.978002 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 349/684] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:43:13 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:43:14.907733 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9882c375-001a-4edd-b697-b38f4edb1869 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:14.910203 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9882c375-001a-4edd-b697-b38f4edb1869 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:14.917373 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9882c375-001a-4edd-b697-b38f4edb1869 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:14.918150 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9882c375-001a-4edd-b697-b38f4edb1869 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:14.918960 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9882c375-001a-4edd-b697-b38f4edb1869 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:14.919545 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9882c375-001a-4edd-b697-b38f4edb1869 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:14.969975 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-85d34a36-976d-4f5e-979e-1253596a6472 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:14.970808 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-85d34a36-976d-4f5e-979e-1253596a6472 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:14.978488 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-85d34a36-976d-4f5e-979e-1253596a6472 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:14.979117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-85d34a36-976d-4f5e-979e-1253596a6472 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:14.980106 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-85d34a36-976d-4f5e-979e-1253596a6472 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:14.980669 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-85d34a36-976d-4f5e-979e-1253596a6472 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:15.163862 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9882c375-001a-4edd-b697-b38f4edb1869 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:15.176168 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9882c375-001a-4edd-b697-b38f4edb1869 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1593 microversion: 2.1 time: 0.272174 Jul 25 05:43:15.177681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 336/685] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:14 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1593 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:15.183615 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9c9cfafa-b488-4ab6-88d7-c5bacc54bf07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:15.184758 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9c9cfafa-b488-4ab6-88d7-c5bacc54bf07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:15.193736 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c9cfafa-b488-4ab6-88d7-c5bacc54bf07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:15.194497 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c9cfafa-b488-4ab6-88d7-c5bacc54bf07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:15.195458 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c9cfafa-b488-4ab6-88d7-c5bacc54bf07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:15.195898 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c9cfafa-b488-4ab6-88d7-c5bacc54bf07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:15.208682 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-85d34a36-976d-4f5e-979e-1253596a6472 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:15.223324 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-85d34a36-976d-4f5e-979e-1253596a6472 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1455 microversion: 2.1 time: 0.257556 Jul 25 05:43:15.224237 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 350/686] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:14 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1455 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:43:15.228823 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-c0e32e26-0fb2-429d-809c-95037b26b81c req-f6163e25-45de-4bfb-8928-9c953364474d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb16475-6c9b-4c00-be15-0b5f68b01d0a", "name": "network-vif-plugged", "status": "completed", "tag": "15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:15.251019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-c0e32e26-0fb2-429d-809c-95037b26b81c req-f6163e25-45de-4bfb-8928-9c953364474d service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:15.252633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-c0e32e26-0fb2-429d-809c-95037b26b81c req-f6163e25-45de-4bfb-8928-9c953364474d service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:15.266058 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=100 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:15.269880 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-c0e32e26-0fb2-429d-809c-95037b26b81c req-f6163e25-45de-4bfb-8928-9c953364474d service nova] Creating event network-vif-plugged:15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc for instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a on hv-cinder-85083 Jul 25 05:43:15.275985 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-c0e32e26-0fb2-429d-809c-95037b26b81c req-f6163e25-45de-4bfb-8928-9c953364474d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050348 Jul 25 05:43:15.276961 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 351/687] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:15.283762 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e920c7e8-4f73-489b-8366-76b1da966d37 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:15.284852 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e920c7e8-4f73-489b-8366-76b1da966d37 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:15.292921 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e920c7e8-4f73-489b-8366-76b1da966d37 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:15.293629 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e920c7e8-4f73-489b-8366-76b1da966d37 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:15.294623 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e920c7e8-4f73-489b-8366-76b1da966d37 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:15.295278 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e920c7e8-4f73-489b-8366-76b1da966d37 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:15.362286 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9c9cfafa-b488-4ab6-88d7-c5bacc54bf07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:15.371175 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9c9cfafa-b488-4ab6-88d7-c5bacc54bf07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:15.372821 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9c9cfafa-b488-4ab6-88d7-c5bacc54bf07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:15.374027 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9c9cfafa-b488-4ab6-88d7-c5bacc54bf07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1406 microversion: 2.20 time: 0.195150 Jul 25 05:43:15.374857 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 337/688] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:43:15 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:43:15.456091 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e920c7e8-4f73-489b-8366-76b1da966d37 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:15.464336 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e920c7e8-4f73-489b-8366-76b1da966d37 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1455 microversion: 2.1 time: 0.186051 Jul 25 05:43:15.465107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 352/689] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:15 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1455 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:16.391715 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e850908e-2902-49ed-a642-222fa5044315 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:16.392533 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e850908e-2902-49ed-a642-222fa5044315 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:16.399627 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e850908e-2902-49ed-a642-222fa5044315 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:16.400089 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e850908e-2902-49ed-a642-222fa5044315 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:16.400925 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e850908e-2902-49ed-a642-222fa5044315 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:16.401375 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e850908e-2902-49ed-a642-222fa5044315 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:16.404431 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:16.638129 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e850908e-2902-49ed-a642-222fa5044315 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:16.646657 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e850908e-2902-49ed-a642-222fa5044315 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:16.648082 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e850908e-2902-49ed-a642-222fa5044315 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:16.649196 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e850908e-2902-49ed-a642-222fa5044315 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1406 microversion: 2.20 time: 0.261534 Jul 25 05:43:16.649748 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 338/690] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:43:16 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:43:17.494929 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-f91f3247-881a-49ef-be4f-684daf86faaf req-45ebb6be-cbfe-4a8f-9051-b304df7de8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc622d78-aba1-429a-8fe6-b3b0252bc63e", "tag": "b0866f27-ba8f-4546-9f9a-870e1b130663"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:17.499925 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=4 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:17.500590 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=8 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:17.506744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-f91f3247-881a-49ef-be4f-684daf86faaf req-45ebb6be-cbfe-4a8f-9051-b304df7de8e5 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:17.506744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-f91f3247-881a-49ef-be4f-684daf86faaf req-45ebb6be-cbfe-4a8f-9051-b304df7de8e5 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:17.518517 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-f91f3247-881a-49ef-be4f-684daf86faaf req-45ebb6be-cbfe-4a8f-9051-b304df7de8e5 service nova] Creating event network-changed:b0866f27-ba8f-4546-9f9a-870e1b130663 for instance bc622d78-aba1-429a-8fe6-b3b0252bc63e on hv-cinder-85083 Jul 25 05:43:17.523689 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-f91f3247-881a-49ef-be4f-684daf86faaf req-45ebb6be-cbfe-4a8f-9051-b304df7de8e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032337 Jul 25 05:43:17.524457 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 353/691] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:43:17.590473 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-b13860f2-245c-4cd0-b9e0-e25d098a0853 req-6091dc1f-a8d3-4bef-bc4f-ed020da86f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a30608a-b03b-41fb-95be-6ba3eba17562", "tag": "8a836452-7655-49c8-9aaf-c2441440165f"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:17.603599 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b13860f2-245c-4cd0-b9e0-e25d098a0853 req-6091dc1f-a8d3-4bef-bc4f-ed020da86f76 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:17.604400 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b13860f2-245c-4cd0-b9e0-e25d098a0853 req-6091dc1f-a8d3-4bef-bc4f-ed020da86f76 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:17.621722 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-b13860f2-245c-4cd0-b9e0-e25d098a0853 req-6091dc1f-a8d3-4bef-bc4f-ed020da86f76 service nova] Creating event network-changed:8a836452-7655-49c8-9aaf-c2441440165f for instance 5a30608a-b03b-41fb-95be-6ba3eba17562 on hv-cinder-85083 Jul 25 05:43:17.629836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-b13860f2-245c-4cd0-b9e0-e25d098a0853 req-6091dc1f-a8d3-4bef-bc4f-ed020da86f76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043260 Jul 25 05:43:17.632232 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 339/692] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:17.683710 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d4c7a257-5131-49a8-9154-34279e519087 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:17.686169 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d4c7a257-5131-49a8-9154-34279e519087 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:17.710768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d4c7a257-5131-49a8-9154-34279e519087 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:17.726763 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d4c7a257-5131-49a8-9154-34279e519087 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:17.729989 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d4c7a257-5131-49a8-9154-34279e519087 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:17.730465 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d4c7a257-5131-49a8-9154-34279e519087 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:17.968355 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d4c7a257-5131-49a8-9154-34279e519087 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:17.980140 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d4c7a257-5131-49a8-9154-34279e519087 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:17.982323 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d4c7a257-5131-49a8-9154-34279e519087 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:17.983792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d4c7a257-5131-49a8-9154-34279e519087 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1406 microversion: 2.20 time: 0.318440 Jul 25 05:43:17.984871 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 354/693] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:43:17 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1406 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:43:19.005906 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-265913f3-ddc5-4b3d-aab0-fe4bffc6f3d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:19.007318 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-265913f3-ddc5-4b3d-aab0-fe4bffc6f3d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:19.022058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-265913f3-ddc5-4b3d-aab0-fe4bffc6f3d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:19.022819 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-265913f3-ddc5-4b3d-aab0-fe4bffc6f3d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:19.024919 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-265913f3-ddc5-4b3d-aab0-fe4bffc6f3d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:19.026877 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-265913f3-ddc5-4b3d-aab0-fe4bffc6f3d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:19.242841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-265913f3-ddc5-4b3d-aab0-fe4bffc6f3d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:19.251681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-265913f3-ddc5-4b3d-aab0-fe4bffc6f3d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:19.253330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-265913f3-ddc5-4b3d-aab0-fe4bffc6f3d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:19.254637 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-265913f3-ddc5-4b3d-aab0-fe4bffc6f3d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1598 microversion: 2.20 time: 0.255624 Jul 25 05:43:19.255220 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 340/694] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:43:18 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1598 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:43:19.275543 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d8628314-cec9-418c-8825-f8fb41cf09b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:19.276051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d8628314-cec9-418c-8825-f8fb41cf09b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:19.277112 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-dffd6c45-ee73-4a28-bfef-34ee66c5dea6 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1191967470"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:19.277657 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-dffd6c45-ee73-4a28-bfef-34ee66c5dea6 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:19.282808 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d8628314-cec9-418c-8825-f8fb41cf09b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:19.283287 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d8628314-cec9-418c-8825-f8fb41cf09b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:19.284639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d8628314-cec9-418c-8825-f8fb41cf09b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:19.285107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d8628314-cec9-418c-8825-f8fb41cf09b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:19.286047 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dffd6c45-ee73-4a28-bfef-34ee66c5dea6 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:19.286538 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dffd6c45-ee73-4a28-bfef-34ee66c5dea6 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:19.287312 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dffd6c45-ee73-4a28-bfef-34ee66c5dea6 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:19.287752 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dffd6c45-ee73-4a28-bfef-34ee66c5dea6 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:19.375846 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d8628314-cec9-418c-8825-f8fb41cf09b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.104258 Jul 25 05:43:19.376457 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 355/695] 10.222.0.33 () {60 vars in 1315 bytes} [Mon Jul 25 05:43:19 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:43:19.452437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.network.security_group_api [None req-dffd6c45-ee73-4a28-bfef-34ee66c5dea6 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Adding security group 182d468d-0d4d-48aa-9fb2-39ecd2e1bb05 to port 8a836452-7655-49c8-9aaf-c2441440165f Jul 25 05:43:19.812717 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-dffd6c45-ee73-4a28-bfef-34ee66c5dea6 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "POST /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/action" status: 202 len: 0 microversion: 2.1 time: 0.539338 Jul 25 05:43:19.813371 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 341/696] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:43:19 2022] POST /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:43:19.821385 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-09f9487c-3bb2-4f36-8f8c-325b198f274c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:19.822209 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-09f9487c-3bb2-4f36-8f8c-325b198f274c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:19.829675 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-09f9487c-3bb2-4f36-8f8c-325b198f274c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:19.830623 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-09f9487c-3bb2-4f36-8f8c-325b198f274c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:19.831636 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-09f9487c-3bb2-4f36-8f8c-325b198f274c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:19.832331 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-09f9487c-3bb2-4f36-8f8c-325b198f274c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:19.833801 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-c17135b6-cf1d-47a0-8411-0da7112713ff req-a250faa6-2a7c-4bdb-b074-ebb4d4f9c140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a30608a-b03b-41fb-95be-6ba3eba17562", "tag": "8a836452-7655-49c8-9aaf-c2441440165f"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:19.846268 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-c17135b6-cf1d-47a0-8411-0da7112713ff req-a250faa6-2a7c-4bdb-b074-ebb4d4f9c140 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:19.851049 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-c17135b6-cf1d-47a0-8411-0da7112713ff req-a250faa6-2a7c-4bdb-b074-ebb4d4f9c140 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:19.895497 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-c17135b6-cf1d-47a0-8411-0da7112713ff req-a250faa6-2a7c-4bdb-b074-ebb4d4f9c140 service nova] Creating event network-changed:8a836452-7655-49c8-9aaf-c2441440165f for instance 5a30608a-b03b-41fb-95be-6ba3eba17562 on hv-cinder-85083 Jul 25 05:43:19.909019 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-c17135b6-cf1d-47a0-8411-0da7112713ff req-a250faa6-2a7c-4bdb-b074-ebb4d4f9c140 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076958 Jul 25 05:43:19.910145 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 342/697] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:43:20.062375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-09f9487c-3bb2-4f36-8f8c-325b198f274c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:20.074421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-09f9487c-3bb2-4f36-8f8c-325b198f274c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1759 microversion: 2.1 time: 0.256402 Jul 25 05:43:20.076648 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 356/698] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:19 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1759 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:21.029880 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-f3e5021e-d530-42db-910b-28f5de0fb99c req-a9bcc440-9f2d-4604-8416-3fb7380f6a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb16475-6c9b-4c00-be15-0b5f68b01d0a", "tag": "15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:21.038918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-f3e5021e-d530-42db-910b-28f5de0fb99c req-a9bcc440-9f2d-4604-8416-3fb7380f6a0e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:21.039376 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-f3e5021e-d530-42db-910b-28f5de0fb99c req-a9bcc440-9f2d-4604-8416-3fb7380f6a0e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:21.050739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-f3e5021e-d530-42db-910b-28f5de0fb99c req-a9bcc440-9f2d-4604-8416-3fb7380f6a0e service nova] Creating event network-changed:15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc for instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a on hv-cinder-85083 Jul 25 05:43:21.055718 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-f3e5021e-d530-42db-910b-28f5de0fb99c req-a9bcc440-9f2d-4604-8416-3fb7380f6a0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030163 Jul 25 05:43:21.056549 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 343/699] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:36.707602 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f087b404-ff69-49c9-a311-7251ecd18891 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:36.708329 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f087b404-ff69-49c9-a311-7251ecd18891 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:36.714237 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:36.715295 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=25 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:36.723120 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f087b404-ff69-49c9-a311-7251ecd18891 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:36.723780 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f087b404-ff69-49c9-a311-7251ecd18891 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:36.725150 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f087b404-ff69-49c9-a311-7251ecd18891 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:36.725851 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f087b404-ff69-49c9-a311-7251ecd18891 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:36.750823 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f087b404-ff69-49c9-a311-7251ecd18891 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/ips" status: 200 len: 148 microversion: 2.1 time: 0.049201 Jul 25 05:43:36.751387 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 357/700] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 25 05:43:36 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/ips => generated 148 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:38.065250 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=85 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:38.066302 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=21 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:38.070709 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0c2a3e1d-74d6-48a0-8fb3-be0754bea248 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d261a0f1-376f-40e4-a467-b846c5ef283e"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:38.071843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0c2a3e1d-74d6-48a0-8fb3-be0754bea248 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:38.079055 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0c2a3e1d-74d6-48a0-8fb3-be0754bea248 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:38.079511 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0c2a3e1d-74d6-48a0-8fb3-be0754bea248 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:38.080271 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0c2a3e1d-74d6-48a0-8fb3-be0754bea248 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:38.081825 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0c2a3e1d-74d6-48a0-8fb3-be0754bea248 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:38.337783 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0c2a3e1d-74d6-48a0-8fb3-be0754bea248 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "POST /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274180 Jul 25 05:43:38.338387 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 344/701] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:43:38 2022] POST /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:45.919708 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-11e22da0-23e0-4dae-88e8-632ec611939e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:45.920216 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-11e22da0-23e0-4dae-88e8-632ec611939e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:45.926297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-11e22da0-23e0-4dae-88e8-632ec611939e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:45.926741 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-11e22da0-23e0-4dae-88e8-632ec611939e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:45.927491 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-11e22da0-23e0-4dae-88e8-632ec611939e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:45.927937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-11e22da0-23e0-4dae-88e8-632ec611939e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:46.006609 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-11e22da0-23e0-4dae-88e8-632ec611939e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lazy-loading 'services' on Instance uuid 0a9692b9-6007-40bf-80f1-a00b4a96d599 {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:43:46.076286 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-11e22da0-23e0-4dae-88e8-632ec611939e tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/os-volume_attachments/d261a0f1-376f-40e4-a467-b846c5ef283e" status: 202 len: 0 microversion: 2.1 time: 0.160534 Jul 25 05:43:46.077376 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 358/702] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:43:45 2022] DELETE /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/os-volume_attachments/d261a0f1-376f-40e4-a467-b846c5ef283e => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:43:46.086099 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0d894462-1306-4be4-8a3d-3e41c837cace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:46.087180 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0d894462-1306-4be4-8a3d-3e41c837cace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:46.093970 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0d894462-1306-4be4-8a3d-3e41c837cace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:46.094430 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0d894462-1306-4be4-8a3d-3e41c837cace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:46.095218 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0d894462-1306-4be4-8a3d-3e41c837cace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:46.095662 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0d894462-1306-4be4-8a3d-3e41c837cace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:46.127269 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0d894462-1306-4be4-8a3d-3e41c837cace tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045631 Jul 25 05:43:46.127865 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 345/703] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:43:46 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:43:47.141738 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-44bbb679-cc7d-4ab6-b1c5-6311ed0ef6a4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:47.142799 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-44bbb679-cc7d-4ab6-b1c5-6311ed0ef6a4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:47.149224 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-44bbb679-cc7d-4ab6-b1c5-6311ed0ef6a4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:47.149665 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-44bbb679-cc7d-4ab6-b1c5-6311ed0ef6a4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:47.150683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-44bbb679-cc7d-4ab6-b1c5-6311ed0ef6a4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:47.151269 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-44bbb679-cc7d-4ab6-b1c5-6311ed0ef6a4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:47.181790 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-44bbb679-cc7d-4ab6-b1c5-6311ed0ef6a4 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046013 Jul 25 05:43:47.182337 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 359/704] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:43:47 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 05:43:47.239172 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f8331874-225d-4f51-9809-f65e374b209b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:47.239678 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f8331874-225d-4f51-9809-f65e374b209b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:47.246015 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f8331874-225d-4f51-9809-f65e374b209b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:47.246469 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f8331874-225d-4f51-9809-f65e374b209b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:47.247234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f8331874-225d-4f51-9809-f65e374b209b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:47.247679 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f8331874-225d-4f51-9809-f65e374b209b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:47.272767 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f8331874-225d-4f51-9809-f65e374b209b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:43:47.344590 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f8331874-225d-4f51-9809-f65e374b209b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 204 len: 0 microversion: 2.1 time: 0.109616 Jul 25 05:43:47.345218 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 346/705] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:43:47 2022] DELETE /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:43:47.354337 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6f3126bf-e9bc-4a79-b8be-0740aacdd718 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:47.354948 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6f3126bf-e9bc-4a79-b8be-0740aacdd718 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:47.361779 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6f3126bf-e9bc-4a79-b8be-0740aacdd718 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:47.362870 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6f3126bf-e9bc-4a79-b8be-0740aacdd718 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:47.364316 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6f3126bf-e9bc-4a79-b8be-0740aacdd718 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:47.364756 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6f3126bf-e9bc-4a79-b8be-0740aacdd718 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:47.495421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6f3126bf-e9bc-4a79-b8be-0740aacdd718 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:47.502868 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6f3126bf-e9bc-4a79-b8be-0740aacdd718 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1681 microversion: 2.1 time: 0.152299 Jul 25 05:43:47.503451 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 360/706] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:47 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:48.520977 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-40886500-7090-487d-bf71-ca923d45f5c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:48.521686 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-40886500-7090-487d-bf71-ca923d45f5c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:48.528141 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40886500-7090-487d-bf71-ca923d45f5c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:48.528595 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40886500-7090-487d-bf71-ca923d45f5c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:48.529396 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40886500-7090-487d-bf71-ca923d45f5c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:48.529834 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40886500-7090-487d-bf71-ca923d45f5c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:48.657395 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-40886500-7090-487d-bf71-ca923d45f5c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:48.665558 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-40886500-7090-487d-bf71-ca923d45f5c9 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1681 microversion: 2.1 time: 0.149322 Jul 25 05:43:48.666130 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 347/707] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:48 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:49.684001 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4dfac4f6-8a7e-42ea-b292-e22da8240777 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:49.684544 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4dfac4f6-8a7e-42ea-b292-e22da8240777 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:49.693138 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4dfac4f6-8a7e-42ea-b292-e22da8240777 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:49.693604 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4dfac4f6-8a7e-42ea-b292-e22da8240777 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:49.694380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4dfac4f6-8a7e-42ea-b292-e22da8240777 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:49.694820 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4dfac4f6-8a7e-42ea-b292-e22da8240777 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:49.832882 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4dfac4f6-8a7e-42ea-b292-e22da8240777 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:49.840487 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4dfac4f6-8a7e-42ea-b292-e22da8240777 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1681 microversion: 2.1 time: 0.160568 Jul 25 05:43:49.841097 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 361/708] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:49 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:50.174308 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-985d66f4-0de8-4785-a0a4-e5b691dfdf1a req-e4343869-f92c-48e0-a2db-b69b8a107fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9692b9-6007-40bf-80f1-a00b4a96d599", "name": "network-vif-deleted", "tag": "dce542e4-936d-4f42-abff-da12f790ddc3"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:50.192185 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-985d66f4-0de8-4785-a0a4-e5b691dfdf1a req-e4343869-f92c-48e0-a2db-b69b8a107fdc service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:50.192951 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-985d66f4-0de8-4785-a0a4-e5b691dfdf1a req-e4343869-f92c-48e0-a2db-b69b8a107fdc service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:50.201647 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c2b4fded-cfe8-4955-b2de-cb7807667998 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:50.202669 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c2b4fded-cfe8-4955-b2de-cb7807667998 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:50.207026 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-985d66f4-0de8-4785-a0a4-e5b691dfdf1a req-e4343869-f92c-48e0-a2db-b69b8a107fdc service nova] Creating event network-vif-deleted:dce542e4-936d-4f42-abff-da12f790ddc3 for instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 on hv-cinder-85083 Jul 25 05:43:50.213778 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-985d66f4-0de8-4785-a0a4-e5b691dfdf1a req-e4343869-f92c-48e0-a2db-b69b8a107fdc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043026 Jul 25 05:43:50.214896 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 348/709] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:50.221045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c2b4fded-cfe8-4955-b2de-cb7807667998 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:50.222495 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c2b4fded-cfe8-4955-b2de-cb7807667998 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:50.223435 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c2b4fded-cfe8-4955-b2de-cb7807667998 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:50.223940 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c2b4fded-cfe8-4955-b2de-cb7807667998 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:50.341649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c2b4fded-cfe8-4955-b2de-cb7807667998 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "POST /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/action" status: 202 len: 0 microversion: 2.1 time: 0.143506 Jul 25 05:43:50.343041 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 362/710] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:43:50 2022] POST /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:43:50.357113 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2240ed46-7342-4df6-bfd0-8912f6f79255 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:50.357849 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2240ed46-7342-4df6-bfd0-8912f6f79255 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:50.371983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2240ed46-7342-4df6-bfd0-8912f6f79255 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:50.373008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2240ed46-7342-4df6-bfd0-8912f6f79255 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:50.374013 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2240ed46-7342-4df6-bfd0-8912f6f79255 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:50.375140 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2240ed46-7342-4df6-bfd0-8912f6f79255 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:50.529711 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2240ed46-7342-4df6-bfd0-8912f6f79255 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:50.538892 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2240ed46-7342-4df6-bfd0-8912f6f79255 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1751 microversion: 2.1 time: 0.190921 Jul 25 05:43:50.539482 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 349/711] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:50 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:50.859560 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-62352dbf-d884-4e3d-b708-4e5adc5665aa tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:50.860305 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-62352dbf-d884-4e3d-b708-4e5adc5665aa tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:50.867172 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-62352dbf-d884-4e3d-b708-4e5adc5665aa tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:50.867875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-62352dbf-d884-4e3d-b708-4e5adc5665aa tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:50.868929 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-62352dbf-d884-4e3d-b708-4e5adc5665aa tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:50.869571 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-62352dbf-d884-4e3d-b708-4e5adc5665aa tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:50.907306 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-62352dbf-d884-4e3d-b708-4e5adc5665aa tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:50.907885 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-62352dbf-d884-4e3d-b708-4e5adc5665aa tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:50.908400 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-62352dbf-d884-4e3d-b708-4e5adc5665aa tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lazy-loading 'fault' on Instance uuid 0a9692b9-6007-40bf-80f1-a00b4a96d599 {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:43:50.955200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-62352dbf-d884-4e3d-b708-4e5adc5665aa tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f3276517de4f889dddd3180436ede9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42066c73ac8f4e5c883204dfc66245c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:50.962586 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-62352dbf-d884-4e3d-b708-4e5adc5665aa tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 200 len: 1332 microversion: 2.1 time: 0.108073 Jul 25 05:43:50.963249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 363/712] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:50 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:51.556145 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fb718192-76be-4779-a3bb-83c656f79779 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:51.556766 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fb718192-76be-4779-a3bb-83c656f79779 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:51.564077 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fb718192-76be-4779-a3bb-83c656f79779 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:51.564540 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fb718192-76be-4779-a3bb-83c656f79779 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:51.565328 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fb718192-76be-4779-a3bb-83c656f79779 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:51.566382 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fb718192-76be-4779-a3bb-83c656f79779 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:51.707127 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fb718192-76be-4779-a3bb-83c656f79779 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:51.715010 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fb718192-76be-4779-a3bb-83c656f79779 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.162731 Jul 25 05:43:51.715573 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 350/713] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:51 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:43:51.981322 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-adc762a6-0555-4e03-9670-d4f8979d398b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:51.981864 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-adc762a6-0555-4e03-9670-d4f8979d398b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:51.989266 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-adc762a6-0555-4e03-9670-d4f8979d398b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:51.989723 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-adc762a6-0555-4e03-9670-d4f8979d398b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:51.990488 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-adc762a6-0555-4e03-9670-d4f8979d398b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:51.990927 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-adc762a6-0555-4e03-9670-d4f8979d398b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:52.004192 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-adc762a6-0555-4e03-9670-d4f8979d398b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-adc762a6-0555-4e03-9670-d4f8979d398b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 HTTP/1.1 Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:43:52.005828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:52.007421 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '0a9692b9-6007-40bf-80f1-a00b4a96d599'} Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:43:52.008351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:52.009898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:52.011360 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-adc762a6-0555-4e03-9670-d4f8979d398b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:43:52.011360 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-adc762a6-0555-4e03-9670-d4f8979d398b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 404 len: 111 microversion: 2.1 time: 0.029849 Jul 25 05:43:52.011360 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 364/714] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:51 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:43:52.016011 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-193b1d5c-52fc-4cc3-b58f-bfce48726d8f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '.version_select at 0x7fcc84cfe9d0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:52.033204 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-193b1d5c-52fc-4cc3-b58f-bfce48726d8f tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081622421" status: 202 len: 0 microversion: 2.1 time: 0.020851 Jul 25 05:43:52.033760 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 351/715] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jul 25 05:43:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081622421 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:43:52.732337 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-78cb377c-5062-440b-aff6-19991033f1ca tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:52.732983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-78cb377c-5062-440b-aff6-19991033f1ca tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:52.740429 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-78cb377c-5062-440b-aff6-19991033f1ca tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:52.740916 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-78cb377c-5062-440b-aff6-19991033f1ca tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:52.741688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-78cb377c-5062-440b-aff6-19991033f1ca tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:52.742130 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-78cb377c-5062-440b-aff6-19991033f1ca tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:52.887956 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-78cb377c-5062-440b-aff6-19991033f1ca tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:52.896384 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-78cb377c-5062-440b-aff6-19991033f1ca tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.167815 Jul 25 05:43:52.896973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 365/716] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:52 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:53.772240 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a4774193-cd80-463c-9f5f-b9166f0821a7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:53.772745 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a4774193-cd80-463c-9f5f-b9166f0821a7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:53.779223 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4774193-cd80-463c-9f5f-b9166f0821a7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:53.779671 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4774193-cd80-463c-9f5f-b9166f0821a7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:53.780440 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4774193-cd80-463c-9f5f-b9166f0821a7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:53.780935 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4774193-cd80-463c-9f5f-b9166f0821a7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:53.793593 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-a4774193-cd80-463c-9f5f-b9166f0821a7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a4774193-cd80-463c-9f5f-b9166f0821a7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 HTTP/1.1 Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:43:53.795228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:53.796741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '0a9692b9-6007-40bf-80f1-a00b4a96d599'} Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:43:53.797844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:53.800616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:53.802320 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a4774193-cd80-463c-9f5f-b9166f0821a7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:43:53.802320 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a4774193-cd80-463c-9f5f-b9166f0821a7 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 404 len: 111 microversion: 2.1 time: 0.028916 Jul 25 05:43:53.802320 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 352/717] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:43:53 2022] DELETE /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:43:53.807532 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7e1fd7db-16aa-4d86-8596-cdf714f98f64 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:53.808150 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7e1fd7db-16aa-4d86-8596-cdf714f98f64 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 0a9692b9-6007-40bf-80f1-a00b4a96d599] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:53.814652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7e1fd7db-16aa-4d86-8596-cdf714f98f64 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:53.815159 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7e1fd7db-16aa-4d86-8596-cdf714f98f64 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:53.816551 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7e1fd7db-16aa-4d86-8596-cdf714f98f64 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:53.817187 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7e1fd7db-16aa-4d86-8596-cdf714f98f64 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:53.830111 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-7e1fd7db-16aa-4d86-8596-cdf714f98f64 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7e1fd7db-16aa-4d86-8596-cdf714f98f64 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 HTTP/1.1 Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:43:53.832430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:53.834047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '0a9692b9-6007-40bf-80f1-a00b4a96d599'} Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:43:53.835045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. Jul 25 05:43:53.836563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:53.838299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7e1fd7db-16aa-4d86-8596-cdf714f98f64 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance 0a9692b9-6007-40bf-80f1-a00b4a96d599 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:43:53.838299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7e1fd7db-16aa-4d86-8596-cdf714f98f64 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599" status: 404 len: 111 microversion: 2.1 time: 0.030109 Jul 25 05:43:53.838299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 366/718] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:53 2022] GET /compute/v2.1/servers/0a9692b9-6007-40bf-80f1-a00b4a96d599 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:43:53.913371 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-68371b67-4765-44cc-af21-fb562873dd44 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:53.914120 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-68371b67-4765-44cc-af21-fb562873dd44 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:53.920210 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-68371b67-4765-44cc-af21-fb562873dd44 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:53.920701 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-68371b67-4765-44cc-af21-fb562873dd44 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:53.923271 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-68371b67-4765-44cc-af21-fb562873dd44 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:53.923774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-68371b67-4765-44cc-af21-fb562873dd44 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:54.066424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-68371b67-4765-44cc-af21-fb562873dd44 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:54.074345 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-68371b67-4765-44cc-af21-fb562873dd44 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.165499 Jul 25 05:43:54.074937 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 353/719] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:53 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:54.974042 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-40267f10-fb5a-4aef-84fe-cf2a3c30a3a6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:54.974557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-40267f10-fb5a-4aef-84fe-cf2a3c30a3a6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:54.981004 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-40267f10-fb5a-4aef-84fe-cf2a3c30a3a6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:54.981457 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-40267f10-fb5a-4aef-84fe-cf2a3c30a3a6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:54.982214 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-40267f10-fb5a-4aef-84fe-cf2a3c30a3a6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:54.982650 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-40267f10-fb5a-4aef-84fe-cf2a3c30a3a6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:54.995715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-40267f10-fb5a-4aef-84fe-cf2a3c30a3a6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-40267f10-fb5a-4aef-84fe-cf2a3c30a3a6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: DELETE /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 HTTP/1.1 Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:43:54.997260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:43:54.998862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': 'fb0ce9ee-f993-48f3-81da-8a31b0a2fc21'} Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:43:54.999983 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:43:55.001649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.003296 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-40267f10-fb5a-4aef-84fe-cf2a3c30a3a6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:43:55.003296 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-40267f10-fb5a-4aef-84fe-cf2a3c30a3a6 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 404 len: 111 microversion: 2.1 time: 0.029253 Jul 25 05:43:55.003296 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 367/720] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:43:54 2022] DELETE /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:43:55.006742 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0dd16d1f-a87a-46f7-a7c3-c9ee862ee8a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:55.007355 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0dd16d1f-a87a-46f7-a7c3-c9ee862ee8a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: fb0ce9ee-f993-48f3-81da-8a31b0a2fc21] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:55.013710 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0dd16d1f-a87a-46f7-a7c3-c9ee862ee8a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:55.014173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0dd16d1f-a87a-46f7-a7c3-c9ee862ee8a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:55.014929 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0dd16d1f-a87a-46f7-a7c3-c9ee862ee8a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:55.015371 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0dd16d1f-a87a-46f7-a7c3-c9ee862ee8a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:55.028762 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-0dd16d1f-a87a-46f7-a7c3-c9ee862ee8a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0dd16d1f-a87a-46f7-a7c3-c9ee862ee8a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 HTTP/1.1 Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:43:55.030297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:43:55.031866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': 'fb0ce9ee-f993-48f3-81da-8a31b0a2fc21'} Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:43:55.032757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. Jul 25 05:43:55.034297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.036253 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0dd16d1f-a87a-46f7-a7c3-c9ee862ee8a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:43:55.036253 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0dd16d1f-a87a-46f7-a7c3-c9ee862ee8a2 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21" status: 404 len: 111 microversion: 2.1 time: 0.028681 Jul 25 05:43:55.036253 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 354/721] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:55 2022] GET /compute/v2.1/servers/fb0ce9ee-f993-48f3-81da-8a31b0a2fc21 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 05:43:55.040499 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4447990c-cd9c-4896-9394-c063c590308b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:55.041035 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4447990c-cd9c-4896-9394-c063c590308b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:55.046980 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4447990c-cd9c-4896-9394-c063c590308b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:55.047426 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4447990c-cd9c-4896-9394-c063c590308b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:55.048182 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4447990c-cd9c-4896-9394-c063c590308b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:55.048622 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4447990c-cd9c-4896-9394-c063c590308b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:55.061742 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-4447990c-cd9c-4896-9394-c063c590308b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4447990c-cd9c-4896-9394-c063c590308b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: DELETE /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 HTTP/1.1 Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:43:55.063249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:43:55.064893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '5529050b-f2cf-4a8d-a44a-aeeff80f9a44'} Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:43:55.065899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:43:55.067370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.068820 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4447990c-cd9c-4896-9394-c063c590308b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:43:55.068820 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4447990c-cd9c-4896-9394-c063c590308b tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 404 len: 111 microversion: 2.1 time: 0.027868 Jul 25 05:43:55.068820 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 368/722] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:43:55 2022] DELETE /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:43:55.072707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-38de27c7-7d51-4ee5-bf43-160845cb6bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:55.073352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-38de27c7-7d51-4ee5-bf43-160845cb6bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: 5529050b-f2cf-4a8d-a44a-aeeff80f9a44] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:55.079224 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-38de27c7-7d51-4ee5-bf43-160845cb6bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:55.079685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-38de27c7-7d51-4ee5-bf43-160845cb6bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:55.080443 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-38de27c7-7d51-4ee5-bf43-160845cb6bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:55.080918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-38de27c7-7d51-4ee5-bf43-160845cb6bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:55.091277 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-32151790-cd87-4679-9e14-bd62fdaf9fe1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:55.091879 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-32151790-cd87-4679-9e14-bd62fdaf9fe1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:55.094561 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-38de27c7-7d51-4ee5-bf43-160845cb6bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-38de27c7-7d51-4ee5-bf43-160845cb6bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 HTTP/1.1 Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:43:55.095994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:43:55.098333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '5529050b-f2cf-4a8d-a44a-aeeff80f9a44'} Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:43:55.099231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. Jul 25 05:43:55.100675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:55.102160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-38de27c7-7d51-4ee5-bf43-160845cb6bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance 5529050b-f2cf-4a8d-a44a-aeeff80f9a44 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:43:55.102160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-38de27c7-7d51-4ee5-bf43-160845cb6bdf tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44" status: 404 len: 111 microversion: 2.1 time: 0.029315 Jul 25 05:43:55.102353 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-32151790-cd87-4679-9e14-bd62fdaf9fe1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:55.102353 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-32151790-cd87-4679-9e14-bd62fdaf9fe1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:55.102353 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-32151790-cd87-4679-9e14-bd62fdaf9fe1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:55.102353 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-32151790-cd87-4679-9e14-bd62fdaf9fe1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:55.102874 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 355/723] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:55 2022] GET /compute/v2.1/servers/5529050b-f2cf-4a8d-a44a-aeeff80f9a44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:43:55.252011 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-32151790-cd87-4679-9e14-bd62fdaf9fe1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:55.260616 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-32151790-cd87-4679-9e14-bd62fdaf9fe1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.173091 Jul 25 05:43:55.261210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 369/724] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:55 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:43:56.235340 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9521f460-1ebd-40eb-b6a6-b109acb921d1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:56.235830 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9521f460-1ebd-40eb-b6a6-b109acb921d1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:56.242201 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9521f460-1ebd-40eb-b6a6-b109acb921d1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:56.242651 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9521f460-1ebd-40eb-b6a6-b109acb921d1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:56.243408 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9521f460-1ebd-40eb-b6a6-b109acb921d1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:56.243844 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9521f460-1ebd-40eb-b6a6-b109acb921d1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:56.259177 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-9521f460-1ebd-40eb-b6a6-b109acb921d1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9521f460-1ebd-40eb-b6a6-b109acb921d1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe HTTP/1.1 Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:43:56.260706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:43:56.262389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': 'f5a28e80-5bf2-46af-9ece-8f7d147629fe'} Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:43:56.263437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:43:56.264910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:43:56.266682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9521f460-1ebd-40eb-b6a6-b109acb921d1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:43:56.266682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9521f460-1ebd-40eb-b6a6-b109acb921d1 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 404 len: 111 microversion: 2.1 time: 0.030625 Jul 25 05:43:56.266682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 356/725] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:43:56 2022] DELETE /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:43:56.271045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c297097f-2ad7-48f9-b2a3-215cf7f1fe79 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:56.271652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c297097f-2ad7-48f9-b2a3-215cf7f1fe79 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] [instance: f5a28e80-5bf2-46af-9ece-8f7d147629fe] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:56.278287 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c297097f-2ad7-48f9-b2a3-215cf7f1fe79 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:56.278450 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-033db316-52d8-4319-b181-630c3584cfb8 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:56.278736 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c297097f-2ad7-48f9-b2a3-215cf7f1fe79 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:56.279040 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-033db316-52d8-4319-b181-630c3584cfb8 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:56.279492 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c297097f-2ad7-48f9-b2a3-215cf7f1fe79 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:56.279931 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c297097f-2ad7-48f9-b2a3-215cf7f1fe79 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:56.285081 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-033db316-52d8-4319-b181-630c3584cfb8 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:56.285583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-033db316-52d8-4319-b181-630c3584cfb8 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:56.286349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-033db316-52d8-4319-b181-630c3584cfb8 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:56.286791 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-033db316-52d8-4319-b181-630c3584cfb8 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:56.293129 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-c297097f-2ad7-48f9-b2a3-215cf7f1fe79 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] HTTP exception thrown: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c297097f-2ad7-48f9-b2a3-215cf7f1fe79 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Request method failure captured: Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe HTTP/1.1 Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iwZ_vRz0cNiv8MRY7ce9cKMekFvtoHiKPl1iYKWOEyRnye7ceosY2Q0eC-irdrseZ4RdoNt1Baza0EhAlWVhAza1JFsr2row0wyJ3k4SPgzV4tpWwx_OojHHimv5-3L6S6EYGsO4HPfT_uwQWR61PpAkqLwE5DRzTTJmYtjU0PXsdI Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:43:56.294640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42066c73ac8f4e5c883204dfc66245c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42066c73ac8f4e5c883204dfc66245c0"}]}] Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 42066c73ac8f4e5c883204dfc66245c0 Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1654321818 Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 69f3276517de4f889dddd3180436ede9 Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeNegativeTest-1654321818-project Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:43:56.295969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': 'f5a28e80-5bf2-46af-9ece-8f7d147629fe'} Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:43:56.296705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. Jul 25 05:43:56.298146 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:43:56.299194 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c297097f-2ad7-48f9-b2a3-215cf7f1fe79 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] Returning 404 to user: Instance f5a28e80-5bf2-46af-9ece-8f7d147629fe could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:43:56.299194 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c297097f-2ad7-48f9-b2a3-215cf7f1fe79 tempest-AttachVolumeNegativeTest-1654321818 tempest-AttachVolumeNegativeTest-1654321818-project] 10.222.0.33 "GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe" status: 404 len: 111 microversion: 2.1 time: 0.029354 Jul 25 05:43:56.299194 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 370/726] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:56 2022] GET /compute/v2.1/servers/f5a28e80-5bf2-46af-9ece-8f7d147629fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:43:56.431885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-033db316-52d8-4319-b181-630c3584cfb8 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:56.439769 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-033db316-52d8-4319-b181-630c3584cfb8 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.165298 Jul 25 05:43:56.440331 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 357/727] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:56 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:43:57.458633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f2866d2a-4eea-4d1a-a396-e03f26f955c1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:57.459257 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f2866d2a-4eea-4d1a-a396-e03f26f955c1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:57.469331 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f2866d2a-4eea-4d1a-a396-e03f26f955c1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:57.470136 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f2866d2a-4eea-4d1a-a396-e03f26f955c1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:57.471137 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f2866d2a-4eea-4d1a-a396-e03f26f955c1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:57.472731 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f2866d2a-4eea-4d1a-a396-e03f26f955c1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:57.634328 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d5118515-2fee-4154-9b69-405337490d0c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:57.634822 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d5118515-2fee-4154-9b69-405337490d0c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:57.640918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d5118515-2fee-4154-9b69-405337490d0c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:57.641369 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d5118515-2fee-4154-9b69-405337490d0c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:57.642387 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d5118515-2fee-4154-9b69-405337490d0c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:57.642924 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d5118515-2fee-4154-9b69-405337490d0c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:57.664439 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f2866d2a-4eea-4d1a-a396-e03f26f955c1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:57.667210 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d5118515-2fee-4154-9b69-405337490d0c tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/ips" status: 200 len: 144 microversion: 2.1 time: 0.167148 Jul 25 05:43:57.667761 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 358/728] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 25 05:43:57 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/ips => generated 144 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:57.675612 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f2866d2a-4eea-4d1a-a396-e03f26f955c1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.221667 Jul 25 05:43:57.676403 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 371/729] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:57 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:58.694954 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a9a49d47-ff36-4d05-84ca-3e3fb4856bc1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:58.695631 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a9a49d47-ff36-4d05-84ca-3e3fb4856bc1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:58.702254 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9a49d47-ff36-4d05-84ca-3e3fb4856bc1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:58.702716 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9a49d47-ff36-4d05-84ca-3e3fb4856bc1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:58.703550 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9a49d47-ff36-4d05-84ca-3e3fb4856bc1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:58.703992 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9a49d47-ff36-4d05-84ca-3e3fb4856bc1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:58.863058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a9a49d47-ff36-4d05-84ca-3e3fb4856bc1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:43:58.874739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a9a49d47-ff36-4d05-84ca-3e3fb4856bc1 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.184465 Jul 25 05:43:58.875792 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 359/730] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:58 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:43:59.027040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-78fb2026-aab8-4d9c-be14-c988fbffabcd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f96364ff-02cb-40ea-b165-3d93ef5a7fbf"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:43:59.028108 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-78fb2026-aab8-4d9c-be14-c988fbffabcd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:59.034533 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-78fb2026-aab8-4d9c-be14-c988fbffabcd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:59.035160 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-78fb2026-aab8-4d9c-be14-c988fbffabcd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:59.035947 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-78fb2026-aab8-4d9c-be14-c988fbffabcd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:59.036393 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-78fb2026-aab8-4d9c-be14-c988fbffabcd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:59.336609 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-78fb2026-aab8-4d9c-be14-c988fbffabcd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "POST /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313296 Jul 25 05:43:59.337270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 372/731] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:43:59 2022] POST /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:43:59.892564 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5a8a429e-8ea8-404c-9fa3-bcf137281f3c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:43:59.893215 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5a8a429e-8ea8-404c-9fa3-bcf137281f3c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:43:59.900667 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a8a429e-8ea8-404c-9fa3-bcf137281f3c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:59.901186 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a8a429e-8ea8-404c-9fa3-bcf137281f3c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:43:59.901961 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a8a429e-8ea8-404c-9fa3-bcf137281f3c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:43:59.902405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a8a429e-8ea8-404c-9fa3-bcf137281f3c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:00.057335 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5a8a429e-8ea8-404c-9fa3-bcf137281f3c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:00.065329 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5a8a429e-8ea8-404c-9fa3-bcf137281f3c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.176637 Jul 25 05:44:00.066427 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 360/732] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:43:59 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:00.781445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-81b27df9-72d1-4778-b5e6-65df5ae8bc3c tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Action: 'create', calling method: .version_select at 0x7fcc841c70d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-392941939", "metadata": {"Type": "work"}}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-81b27df9-72d1-4778-b5e6-65df5ae8bc3c tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Request method failure captured: Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 121 Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3i2gzZAj0HyUj7ld9FSvfr_iH39y0S63d7W8SiiKKAG9Svnhd8o55X39lq2SwsJSeqDnK7ATtfMsFN2-a7olnSdnTymS0CejVrTVC_DT6E6Y-CmDOOBwe3y_6Z9jZGZiVnbcfGkiFmDt08dtjAE1Q8_3tXeuIft-fAqksV2plwy6vnE Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:44:00.797752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16d64ce24f244cb5b4ba265faecf4d04"}]}] Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 661e1ffef5d94740b16789823ba08d54 Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-392941939", "metadata": {"Type": "work"}}} Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: Jul 25 05:44:00.799380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-392941939', 'metadata': {'Type': 'work'}}}} Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise error Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:00.800557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 05:44:00.802422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 05:44:00.803818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 05:44:00.803818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.803818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-81b27df9-72d1-4778-b5e6-65df5ae8bc3c tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:00.803818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-81b27df9-72d1-4778-b5e6-65df5ae8bc3c tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132326 Jul 25 05:44:00.803818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 373/733] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jul 25 05:44:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 05:44:00.810534 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a6dbe0c3-609e-436d-8c2f-fa04b5f95c59 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Action: 'create', calling method: .version_select at 0x7fcc844465e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-821574382", "metadata": {"Type": "work"}}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a6dbe0c3-609e-436d-8c2f-fa04b5f95c59 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Request method failure captured: Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 119 Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3i2gzZAj0HyUj7ld9FSvfr_iH39y0S63d7W8SiiKKAG9Svnhd8o55X39lq2SwsJSeqDnK7ATtfMsFN2-a7olnSdnTymS0CejVrTVC_DT6E6Y-CmDOOBwe3y_6Z9jZGZiVnbcfGkiFmDt08dtjAE1Q8_3tXeuIft-fAqksV2plwy6vnE Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:44:00.813754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16d64ce24f244cb5b4ba265faecf4d04"}]}] Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 661e1ffef5d94740b16789823ba08d54 Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-821574382", "metadata": {"Type": "work"}}} Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: Jul 25 05:44:00.815321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-821574382', 'metadata': {'Type': 'work'}}}} Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise error Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi '0' Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:00.816841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 05:44:00.818184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 05:44:00.819406 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 05:44:00.819406 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.819406 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a6dbe0c3-609e-436d-8c2f-fa04b5f95c59 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:00.819406 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a6dbe0c3-609e-436d-8c2f-fa04b5f95c59 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008525 Jul 25 05:44:00.819406 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 361/734] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jul 25 05:44:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 05:44:00.824956 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ba4631d2-6ed0-40d9-ae07-0e81a51a5c60 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Action: 'create', calling method: .version_select at 0x7fcc841af8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1543963924", "metadata": {"Type": "work"}}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ba4631d2-6ed0-40d9-ae07-0e81a51a5c60 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Request method failure captured: Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 119 Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3i2gzZAj0HyUj7ld9FSvfr_iH39y0S63d7W8SiiKKAG9Svnhd8o55X39lq2SwsJSeqDnK7ATtfMsFN2-a7olnSdnTymS0CejVrTVC_DT6E6Y-CmDOOBwe3y_6Z9jZGZiVnbcfGkiFmDt08dtjAE1Q8_3tXeuIft-fAqksV2plwy6vnE Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:44:00.827212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16d64ce24f244cb5b4ba265faecf4d04"}]}] Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 661e1ffef5d94740b16789823ba08d54 Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1543963924", "metadata": {"Type": "work"}}} Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: Jul 25 05:44:00.828728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1543963924', 'metadata': {'Type': 'work'}}}} Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise error Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi '' Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:00.829704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 05:44:00.831375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 05:44:00.832632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 05:44:00.832632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.832632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ba4631d2-6ed0-40d9-ae07-0e81a51a5c60 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:00.832632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ba4631d2-6ed0-40d9-ae07-0e81a51a5c60 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007386 Jul 25 05:44:00.832632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 374/735] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jul 25 05:44:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 05:44:00.837773 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5239048f-2fa2-4492-a149-e5c9bf7dba22 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Calling method '.version_select at 0x7fcc8432b940>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:00.866176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-5239048f-2fa2-4492-a149-e5c9bf7dba22 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] HTTP exception thrown: Volume tempest-invalid-150426839 could not be found. Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5239048f-2fa2-4492-a149-e5c9bf7dba22 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Request method failure captured: Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-150426839 HTTP/1.1 Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3i2gzZAj0HyUj7ld9FSvfr_iH39y0S63d7W8SiiKKAG9Svnhd8o55X39lq2SwsJSeqDnK7ATtfMsFN2-a7olnSdnTymS0CejVrTVC_DT6E6Y-CmDOOBwe3y_6Z9jZGZiVnbcfGkiFmDt08dtjAE1Q8_3tXeuIft-fAqksV2plwy6vnE Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:44:00.870409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16d64ce24f244cb5b4ba265faecf4d04"}]}] Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 661e1ffef5d94740b16789823ba08d54 Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Volume tempest-invalid-150426839 could not be found. Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': 'tempest-invalid-150426839'} Jul 25 05:44:00.871972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-150426839 could not be found. (HTTP 404) (Request-ID: req-dff73e70-2c5d-4a93-8bd3-2851c9cb96c4) Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.873023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:44:00.874426 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-150426839 could not be found. Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:44:00.875728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-150426839 could not be found. Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-150426839 could not be found. Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5239048f-2fa2-4492-a149-e5c9bf7dba22 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Returning 404 to user: Volume tempest-invalid-150426839 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5239048f-2fa2-4492-a149-e5c9bf7dba22 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-150426839" status: 404 len: 98 microversion: 2.1 time: 0.037681 Jul 25 05:44:00.877176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 362/736] 10.222.0.33 () {58 vars in 1214 bytes} [Mon Jul 25 05:44:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-150426839 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 05:44:00.883190 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f6a08927-8e56-4e20-bbed-9068eff8bb70 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004568 Jul 25 05:44:00.883677 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 375/737] 10.222.0.33 () {58 vars in 1139 bytes} [Mon Jul 25 05:44:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 05:44:00.891697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d19d2478-ed0a-4d0a-a071-ad2a1a57b86f tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003625 Jul 25 05:44:00.892183 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 363/738] 10.222.0.33 () {58 vars in 1136 bytes} [Mon Jul 25 05:44:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 25 05:44:00.899842 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-625ad8e5-bbe8-41f9-af3b-1e9381bc4233 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Calling method '.version_select at 0x7fcc841f6ca0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:00.928277 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-625ad8e5-bbe8-41f9-af3b-1e9381bc4233 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] HTTP exception thrown: Volume 5fa292b4-48fe-4840-ab4c-b351b7111929 could not be found. Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-625ad8e5-bbe8-41f9-af3b-1e9381bc4233 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Request method failure captured: Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: DELETE /compute/v2.1/os-volumes/5fa292b4-48fe-4840-ab4c-b351b7111929 HTTP/1.1 Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3i2gzZAj0HyUj7ld9FSvfr_iH39y0S63d7W8SiiKKAG9Svnhd8o55X39lq2SwsJSeqDnK7ATtfMsFN2-a7olnSdnTymS0CejVrTVC_DT6E6Y-CmDOOBwe3y_6Z9jZGZiVnbcfGkiFmDt08dtjAE1Q8_3tXeuIft-fAqksV2plwy6vnE Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:44:00.930297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16d64ce24f244cb5b4ba265faecf4d04"}]}] Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 661e1ffef5d94740b16789823ba08d54 Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Volume 5fa292b4-48fe-4840-ab4c-b351b7111929 could not be found. Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '5fa292b4-48fe-4840-ab4c-b351b7111929'} Jul 25 05:44:00.931809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5fa292b4-48fe-4840-ab4c-b351b7111929 could not be found. (HTTP 404) (Request-ID: req-a45d7982-5dd4-45f9-8a6c-46dbbbe06c56) Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.932767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:44:00.934270 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5fa292b4-48fe-4840-ab4c-b351b7111929 could not be found. Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 05:44:00.935436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5fa292b4-48fe-4840-ab4c-b351b7111929 could not be found. Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5fa292b4-48fe-4840-ab4c-b351b7111929 could not be found. Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-625ad8e5-bbe8-41f9-af3b-1e9381bc4233 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Returning 404 to user: Volume 5fa292b4-48fe-4840-ab4c-b351b7111929 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-625ad8e5-bbe8-41f9-af3b-1e9381bc4233 tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/5fa292b4-48fe-4840-ab4c-b351b7111929" status: 404 len: 109 microversion: 2.1 time: 0.035174 Jul 25 05:44:00.936937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 376/739] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 25 05:44:00 2022] DELETE /compute/v2.1/os-volumes/5fa292b4-48fe-4840-ab4c-b351b7111929 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:44:00.942681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e987654e-09d3-4f91-b32e-286b5847843f tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Calling method '.version_select at 0x7fcc84306280>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:00.969052 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-e987654e-09d3-4f91-b32e-286b5847843f tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] HTTP exception thrown: Volume 3c18cf8a-b57f-4dfa-a3d9-ca37d9a2bd0b could not be found. Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e987654e-09d3-4f91-b32e-286b5847843f tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Request method failure captured: Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/os-volumes/3c18cf8a-b57f-4dfa-a3d9-ca37d9a2bd0b HTTP/1.1 Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3i2gzZAj0HyUj7ld9FSvfr_iH39y0S63d7W8SiiKKAG9Svnhd8o55X39lq2SwsJSeqDnK7ATtfMsFN2-a7olnSdnTymS0CejVrTVC_DT6E6Y-CmDOOBwe3y_6Z9jZGZiVnbcfGkiFmDt08dtjAE1Q8_3tXeuIft-fAqksV2plwy6vnE Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:44:00.970976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16d64ce24f244cb5b4ba265faecf4d04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16d64ce24f244cb5b4ba265faecf4d04"}]}] Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 16d64ce24f244cb5b4ba265faecf4d04 Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesNegativeTest-1839544888 Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 661e1ffef5d94740b16789823ba08d54 Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesNegativeTest-1839544888-project Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Volume 3c18cf8a-b57f-4dfa-a3d9-ca37d9a2bd0b could not be found. Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '3c18cf8a-b57f-4dfa-a3d9-ca37d9a2bd0b'} Jul 25 05:44:00.973058 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c18cf8a-b57f-4dfa-a3d9-ca37d9a2bd0b could not be found. (HTTP 404) (Request-ID: req-d2288860-9911-4dc7-af28-01878e05ac2c) Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.974008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:44:00.975468 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c18cf8a-b57f-4dfa-a3d9-ca37d9a2bd0b could not be found. Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 05:44:00.976739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c18cf8a-b57f-4dfa-a3d9-ca37d9a2bd0b could not be found. Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c18cf8a-b57f-4dfa-a3d9-ca37d9a2bd0b could not be found. Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e987654e-09d3-4f91-b32e-286b5847843f tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] Returning 404 to user: Volume 3c18cf8a-b57f-4dfa-a3d9-ca37d9a2bd0b could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e987654e-09d3-4f91-b32e-286b5847843f tempest-VolumesNegativeTest-1839544888 tempest-VolumesNegativeTest-1839544888-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3c18cf8a-b57f-4dfa-a3d9-ca37d9a2bd0b" status: 404 len: 109 microversion: 2.1 time: 0.035365 Jul 25 05:44:00.978281 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 364/740] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 25 05:44:00 2022] GET /compute/v2.1/os-volumes/3c18cf8a-b57f-4dfa-a3d9-ca37d9a2bd0b => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:44:01.082932 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4f817275-0754-4528-a8e3-7ca3e2c9452b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:01.083825 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4f817275-0754-4528-a8e3-7ca3e2c9452b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:01.091330 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f817275-0754-4528-a8e3-7ca3e2c9452b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:01.091777 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f817275-0754-4528-a8e3-7ca3e2c9452b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:01.092541 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f817275-0754-4528-a8e3-7ca3e2c9452b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:01.093008 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f817275-0754-4528-a8e3-7ca3e2c9452b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:01.239745 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4f817275-0754-4528-a8e3-7ca3e2c9452b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:01.243332 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:44:01.248392 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4f817275-0754-4528-a8e3-7ca3e2c9452b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.169404 Jul 25 05:44:01.248977 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 377/741] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:01 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:02.266697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cf1edb78-6c62-412c-b73e-8f4590f0d150 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:02.267345 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cf1edb78-6c62-412c-b73e-8f4590f0d150 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:02.274422 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cf1edb78-6c62-412c-b73e-8f4590f0d150 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:02.274881 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cf1edb78-6c62-412c-b73e-8f4590f0d150 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:02.275651 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cf1edb78-6c62-412c-b73e-8f4590f0d150 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:02.276089 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cf1edb78-6c62-412c-b73e-8f4590f0d150 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:02.429713 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cf1edb78-6c62-412c-b73e-8f4590f0d150 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:02.439052 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cf1edb78-6c62-412c-b73e-8f4590f0d150 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.175886 Jul 25 05:44:02.439617 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 365/742] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:02 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:03.456327 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-fe0f90f0-af0a-45bd-9761-59ad426e99db tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:03.456990 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-fe0f90f0-af0a-45bd-9761-59ad426e99db tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:03.465363 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fe0f90f0-af0a-45bd-9761-59ad426e99db tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:03.465815 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fe0f90f0-af0a-45bd-9761-59ad426e99db tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:03.466572 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fe0f90f0-af0a-45bd-9761-59ad426e99db tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:03.467008 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fe0f90f0-af0a-45bd-9761-59ad426e99db tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:03.633461 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-fe0f90f0-af0a-45bd-9761-59ad426e99db tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:03.641627 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-fe0f90f0-af0a-45bd-9761-59ad426e99db tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.189051 Jul 25 05:44:03.642192 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 378/743] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:03 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:04.658722 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9f18735f-9a71-4e14-9852-b1f60caa8c5d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:04.659341 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9f18735f-9a71-4e14-9852-b1f60caa8c5d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:04.666567 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f18735f-9a71-4e14-9852-b1f60caa8c5d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:04.667249 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f18735f-9a71-4e14-9852-b1f60caa8c5d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:04.668024 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f18735f-9a71-4e14-9852-b1f60caa8c5d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:04.668466 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f18735f-9a71-4e14-9852-b1f60caa8c5d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:04.684636 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:44:04.827141 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9f18735f-9a71-4e14-9852-b1f60caa8c5d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:04.835378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9f18735f-9a71-4e14-9852-b1f60caa8c5d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.180377 Jul 25 05:44:04.835946 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 366/744] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:04 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:05.451247 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4935c7a2-ba42-4ac4-b7db-405d8310c006 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:05.451768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4935c7a2-ba42-4ac4-b7db-405d8310c006 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:05.459654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4935c7a2-ba42-4ac4-b7db-405d8310c006 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:05.460034 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4935c7a2-ba42-4ac4-b7db-405d8310c006 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:05.460817 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4935c7a2-ba42-4ac4-b7db-405d8310c006 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:05.461258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4935c7a2-ba42-4ac4-b7db-405d8310c006 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:05.484977 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4935c7a2-ba42-4ac4-b7db-405d8310c006 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/ips" status: 200 len: 150 microversion: 2.20 time: 0.037525 Jul 25 05:44:05.485537 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 379/745] 10.222.0.33 () {60 vars in 1288 bytes} [Mon Jul 25 05:44:05 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:44:05.852565 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6815a854-aee8-4a6f-a291-f1f7e7cc772f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:05.853214 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6815a854-aee8-4a6f-a291-f1f7e7cc772f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:05.861691 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6815a854-aee8-4a6f-a291-f1f7e7cc772f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:05.862337 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6815a854-aee8-4a6f-a291-f1f7e7cc772f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:05.863359 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6815a854-aee8-4a6f-a291-f1f7e7cc772f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:05.864147 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6815a854-aee8-4a6f-a291-f1f7e7cc772f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:06.027399 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6815a854-aee8-4a6f-a291-f1f7e7cc772f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:06.037324 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6815a854-aee8-4a6f-a291-f1f7e7cc772f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.188427 Jul 25 05:44:06.037901 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 367/746] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:05 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:06.929926 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-26a4152f-caf7-45fe-a4a3-5f6bafb1d096 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:06.930907 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-26a4152f-caf7-45fe-a4a3-5f6bafb1d096 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:06.933225 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=41 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:44:06.938996 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26a4152f-caf7-45fe-a4a3-5f6bafb1d096 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:06.939444 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26a4152f-caf7-45fe-a4a3-5f6bafb1d096 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:06.940221 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26a4152f-caf7-45fe-a4a3-5f6bafb1d096 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:06.940660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-26a4152f-caf7-45fe-a4a3-5f6bafb1d096 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:06.969966 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-26a4152f-caf7-45fe-a4a3-5f6bafb1d096 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044086 Jul 25 05:44:06.970524 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 380/747] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:06 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:06.981546 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d749840e-8f99-4147-aa5d-777be4dd6bff tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:06.982078 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d749840e-8f99-4147-aa5d-777be4dd6bff tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:06.988593 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d749840e-8f99-4147-aa5d-777be4dd6bff tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:06.989112 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d749840e-8f99-4147-aa5d-777be4dd6bff tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:06.990757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d749840e-8f99-4147-aa5d-777be4dd6bff tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:06.991218 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d749840e-8f99-4147-aa5d-777be4dd6bff tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:07.022910 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d749840e-8f99-4147-aa5d-777be4dd6bff tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments/f96364ff-02cb-40ea-b165-3d93ef5a7fbf" status: 200 len: 194 microversion: 2.1 time: 0.045389 Jul 25 05:44:07.023486 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 368/748] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jul 25 05:44:06 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments/f96364ff-02cb-40ea-b165-3d93ef5a7fbf => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:07.054920 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-33eaa14e-3124-4568-b7b1-82e253ee2b79 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:07.055625 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-33eaa14e-3124-4568-b7b1-82e253ee2b79 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:07.061912 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-33eaa14e-3124-4568-b7b1-82e253ee2b79 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:07.062366 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-33eaa14e-3124-4568-b7b1-82e253ee2b79 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:07.063128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-33eaa14e-3124-4568-b7b1-82e253ee2b79 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:07.063567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-33eaa14e-3124-4568-b7b1-82e253ee2b79 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:07.236953 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-33eaa14e-3124-4568-b7b1-82e253ee2b79 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:07.247467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-33eaa14e-3124-4568-b7b1-82e253ee2b79 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1756 microversion: 2.1 time: 0.196258 Jul 25 05:44:07.248357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 381/749] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:07 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:07.442491 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-97921885-cab9-4724-b486-f8293b6c32c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:07.443245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-97921885-cab9-4724-b486-f8293b6c32c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:07.449168 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97921885-cab9-4724-b486-f8293b6c32c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:07.449629 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97921885-cab9-4724-b486-f8293b6c32c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:07.450394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97921885-cab9-4724-b486-f8293b6c32c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:07.450832 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97921885-cab9-4724-b486-f8293b6c32c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:07.477330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-97921885-cab9-4724-b486-f8293b6c32c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lazy-loading 'flavor' on Instance uuid cbb16475-6c9b-4c00-be15-0b5f68b01d0a {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:44:07.803967 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-97921885-cab9-4724-b486-f8293b6c32c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "POST /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/action" status: 202 len: 0 microversion: 2.20 time: 0.365819 Jul 25 05:44:07.804761 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 369/750] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jul 25 05:44:07 2022] POST /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:44:07.814215 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-16f5f726-c98c-46ae-8b41-bf6933f6e749 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:07.814835 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-16f5f726-c98c-46ae-8b41-bf6933f6e749 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:07.827303 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-16f5f726-c98c-46ae-8b41-bf6933f6e749 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:07.827766 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-16f5f726-c98c-46ae-8b41-bf6933f6e749 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:07.828540 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-16f5f726-c98c-46ae-8b41-bf6933f6e749 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:07.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-16f5f726-c98c-46ae-8b41-bf6933f6e749 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:07.961157 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-16f5f726-c98c-46ae-8b41-bf6933f6e749 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:07.968995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-16f5f726-c98c-46ae-8b41-bf6933f6e749 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:07.970491 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-16f5f726-c98c-46ae-8b41-bf6933f6e749 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:07.971632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-16f5f726-c98c-46ae-8b41-bf6933f6e749 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.162223 Jul 25 05:44:07.972186 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 382/751] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:07 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:08.268552 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6f65cb8a-4480-4839-9ee6-087e8727b350 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:08.269197 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6f65cb8a-4480-4839-9ee6-087e8727b350 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:08.271172 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:44:08.276753 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6f65cb8a-4480-4839-9ee6-087e8727b350 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:08.277232 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6f65cb8a-4480-4839-9ee6-087e8727b350 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:08.277988 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6f65cb8a-4480-4839-9ee6-087e8727b350 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:08.278424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6f65cb8a-4480-4839-9ee6-087e8727b350 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:08.434371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5d4c3991-1aeb-4934-911c-45985f66f870 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8b4a96d-2402-42b0-91e4-bb72665952d2"}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:08.435469 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5d4c3991-1aeb-4934-911c-45985f66f870 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:08.438054 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6f65cb8a-4480-4839-9ee6-087e8727b350 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:08.442097 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5d4c3991-1aeb-4934-911c-45985f66f870 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:08.442554 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5d4c3991-1aeb-4934-911c-45985f66f870 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:08.443936 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5d4c3991-1aeb-4934-911c-45985f66f870 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:08.444556 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5d4c3991-1aeb-4934-911c-45985f66f870 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:08.446784 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6f65cb8a-4480-4839-9ee6-087e8727b350 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1759 microversion: 2.1 time: 0.182863 Jul 25 05:44:08.447716 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 370/752] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:08 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:08.724531 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5d4c3991-1aeb-4934-911c-45985f66f870 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "POST /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293528 Jul 25 05:44:08.725515 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 383/753] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 25 05:44:08 2022] POST /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:44:08.991445 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cbd981d7-7b32-41a7-aa21-d774307ae167 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:08.992054 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cbd981d7-7b32-41a7-aa21-d774307ae167 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:08.998160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbd981d7-7b32-41a7-aa21-d774307ae167 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:08.998620 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbd981d7-7b32-41a7-aa21-d774307ae167 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:08.999441 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbd981d7-7b32-41a7-aa21-d774307ae167 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:08.999882 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbd981d7-7b32-41a7-aa21-d774307ae167 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:09.133491 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cbd981d7-7b32-41a7-aa21-d774307ae167 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:09.141262 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cbd981d7-7b32-41a7-aa21-d774307ae167 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:09.142833 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cbd981d7-7b32-41a7-aa21-d774307ae167 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:09.144020 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cbd981d7-7b32-41a7-aa21-d774307ae167 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.157546 Jul 25 05:44:09.144569 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 371/754] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:08 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:10.163894 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ae03f3bd-6fec-42b8-a2f3-3b3197886ab0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:10.164588 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ae03f3bd-6fec-42b8-a2f3-3b3197886ab0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:10.170729 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ae03f3bd-6fec-42b8-a2f3-3b3197886ab0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:10.171175 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ae03f3bd-6fec-42b8-a2f3-3b3197886ab0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:10.171928 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ae03f3bd-6fec-42b8-a2f3-3b3197886ab0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:10.172365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ae03f3bd-6fec-42b8-a2f3-3b3197886ab0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:10.306313 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ae03f3bd-6fec-42b8-a2f3-3b3197886ab0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:10.314788 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ae03f3bd-6fec-42b8-a2f3-3b3197886ab0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:10.316329 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ae03f3bd-6fec-42b8-a2f3-3b3197886ab0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:10.317542 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ae03f3bd-6fec-42b8-a2f3-3b3197886ab0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.159045 Jul 25 05:44:10.318206 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 384/755] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:10 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:11.336079 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7cf810cc-ac9a-4bce-84bc-983594d3592b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:11.336700 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7cf810cc-ac9a-4bce-84bc-983594d3592b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:11.343263 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7cf810cc-ac9a-4bce-84bc-983594d3592b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:11.343715 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7cf810cc-ac9a-4bce-84bc-983594d3592b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:11.344475 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7cf810cc-ac9a-4bce-84bc-983594d3592b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:11.344952 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7cf810cc-ac9a-4bce-84bc-983594d3592b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:11.475345 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7cf810cc-ac9a-4bce-84bc-983594d3592b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:11.483232 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7cf810cc-ac9a-4bce-84bc-983594d3592b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:11.484738 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7cf810cc-ac9a-4bce-84bc-983594d3592b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:11.485921 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7cf810cc-ac9a-4bce-84bc-983594d3592b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.154455 Jul 25 05:44:11.486487 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 372/756] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:11 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:12.504658 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b44ae2c6-98cd-434c-8103-dc9159bcee70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:12.505312 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b44ae2c6-98cd-434c-8103-dc9159bcee70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:12.512489 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b44ae2c6-98cd-434c-8103-dc9159bcee70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:12.512977 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b44ae2c6-98cd-434c-8103-dc9159bcee70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:12.513739 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b44ae2c6-98cd-434c-8103-dc9159bcee70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:12.514180 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b44ae2c6-98cd-434c-8103-dc9159bcee70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:12.645718 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b44ae2c6-98cd-434c-8103-dc9159bcee70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:12.655052 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b44ae2c6-98cd-434c-8103-dc9159bcee70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:12.656663 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b44ae2c6-98cd-434c-8103-dc9159bcee70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:12.657948 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b44ae2c6-98cd-434c-8103-dc9159bcee70 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.157145 Jul 25 05:44:12.658581 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 385/757] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:12 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:13.678160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0389e65d-b381-4912-91d0-19f4996f75d3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:13.678951 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0389e65d-b381-4912-91d0-19f4996f75d3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:13.685635 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0389e65d-b381-4912-91d0-19f4996f75d3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:13.686098 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0389e65d-b381-4912-91d0-19f4996f75d3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:13.686885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0389e65d-b381-4912-91d0-19f4996f75d3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:13.687356 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0389e65d-b381-4912-91d0-19f4996f75d3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:13.818217 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0389e65d-b381-4912-91d0-19f4996f75d3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:13.826313 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0389e65d-b381-4912-91d0-19f4996f75d3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:13.827817 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0389e65d-b381-4912-91d0-19f4996f75d3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:13.829047 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0389e65d-b381-4912-91d0-19f4996f75d3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.156325 Jul 25 05:44:13.829601 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 373/758] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:13 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:14.847908 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b8941d29-8ccc-4ffd-97d1-99fd78aa5160 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:14.848513 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b8941d29-8ccc-4ffd-97d1-99fd78aa5160 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:14.855820 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b8941d29-8ccc-4ffd-97d1-99fd78aa5160 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:14.856666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b8941d29-8ccc-4ffd-97d1-99fd78aa5160 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:14.857528 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b8941d29-8ccc-4ffd-97d1-99fd78aa5160 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:14.857984 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b8941d29-8ccc-4ffd-97d1-99fd78aa5160 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:14.985457 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b8941d29-8ccc-4ffd-97d1-99fd78aa5160 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:14.993306 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b8941d29-8ccc-4ffd-97d1-99fd78aa5160 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:14.994827 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b8941d29-8ccc-4ffd-97d1-99fd78aa5160 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:14.995979 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b8941d29-8ccc-4ffd-97d1-99fd78aa5160 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.152183 Jul 25 05:44:14.996540 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 386/759] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:14 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:16.014633 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-435854c9-0b0c-48d3-bf72-2f699069690d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:16.015425 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-435854c9-0b0c-48d3-bf72-2f699069690d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:16.022486 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-435854c9-0b0c-48d3-bf72-2f699069690d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:16.023121 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-435854c9-0b0c-48d3-bf72-2f699069690d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:16.024053 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-435854c9-0b0c-48d3-bf72-2f699069690d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:16.024576 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-435854c9-0b0c-48d3-bf72-2f699069690d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:16.186763 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-435854c9-0b0c-48d3-bf72-2f699069690d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:16.195125 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-435854c9-0b0c-48d3-bf72-2f699069690d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:16.196637 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-435854c9-0b0c-48d3-bf72-2f699069690d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:16.198144 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-435854c9-0b0c-48d3-bf72-2f699069690d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.187257 Jul 25 05:44:16.198855 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 374/760] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:16 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:16.239301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-0ae46394-a065-4b77-8238-8587c89e0711 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:16.240375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-0ae46394-a065-4b77-8238-8587c89e0711 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:16.247797 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0ae46394-a065-4b77-8238-8587c89e0711 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:16.248262 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0ae46394-a065-4b77-8238-8587c89e0711 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:16.249077 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0ae46394-a065-4b77-8238-8587c89e0711 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:16.249522 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-0ae46394-a065-4b77-8238-8587c89e0711 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:16.278765 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-0ae46394-a065-4b77-8238-8587c89e0711 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043537 Jul 25 05:44:16.279331 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 387/761] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:16 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:44:16.419473 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-35ed771b-8871-46f0-9285-0d2823b8a9e8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:16.419965 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-35ed771b-8871-46f0-9285-0d2823b8a9e8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:16.426260 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-35ed771b-8871-46f0-9285-0d2823b8a9e8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:16.426714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-35ed771b-8871-46f0-9285-0d2823b8a9e8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:16.427476 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-35ed771b-8871-46f0-9285-0d2823b8a9e8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:16.427915 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-35ed771b-8871-46f0-9285-0d2823b8a9e8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:16.456647 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-35ed771b-8871-46f0-9285-0d2823b8a9e8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments/f96364ff-02cb-40ea-b165-3d93ef5a7fbf" status: 200 len: 194 microversion: 2.1 time: 0.041033 Jul 25 05:44:16.457261 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 375/762] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jul 25 05:44:16 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments/f96364ff-02cb-40ea-b165-3d93ef5a7fbf => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:16.467025 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7a4348e6-2805-4048-becf-7894e5933398 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:16.467531 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7a4348e6-2805-4048-becf-7894e5933398 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:16.473756 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7a4348e6-2805-4048-becf-7894e5933398 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:16.474216 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7a4348e6-2805-4048-becf-7894e5933398 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:16.475545 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7a4348e6-2805-4048-becf-7894e5933398 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:16.476261 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7a4348e6-2805-4048-becf-7894e5933398 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:16.558433 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-7a4348e6-2805-4048-becf-7894e5933398 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lazy-loading 'services' on Instance uuid 4d3a0531-7a5e-4b9c-bb23-5079be9a101d {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:44:16.632328 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7a4348e6-2805-4048-becf-7894e5933398 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments/f96364ff-02cb-40ea-b165-3d93ef5a7fbf" status: 202 len: 0 microversion: 2.1 time: 0.168957 Jul 25 05:44:16.633010 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 388/763] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:44:16 2022] DELETE /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments/f96364ff-02cb-40ea-b165-3d93ef5a7fbf => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:44:17.216494 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-28bec3ee-7d53-4f67-97e2-1d3665c91293 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:17.217125 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-28bec3ee-7d53-4f67-97e2-1d3665c91293 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:17.223727 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28bec3ee-7d53-4f67-97e2-1d3665c91293 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:17.224173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28bec3ee-7d53-4f67-97e2-1d3665c91293 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:17.225540 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28bec3ee-7d53-4f67-97e2-1d3665c91293 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:17.225996 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28bec3ee-7d53-4f67-97e2-1d3665c91293 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:17.357434 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-28bec3ee-7d53-4f67-97e2-1d3665c91293 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:17.365269 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-28bec3ee-7d53-4f67-97e2-1d3665c91293 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:17.367408 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-28bec3ee-7d53-4f67-97e2-1d3665c91293 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:17.368551 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-28bec3ee-7d53-4f67-97e2-1d3665c91293 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.155934 Jul 25 05:44:17.369156 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 376/764] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:17 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:18.388057 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-77659ce2-a7ba-447b-87ec-4e815823ade3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:18.388798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-77659ce2-a7ba-447b-87ec-4e815823ade3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:18.395040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-77659ce2-a7ba-447b-87ec-4e815823ade3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:18.395492 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-77659ce2-a7ba-447b-87ec-4e815823ade3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:18.396253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-77659ce2-a7ba-447b-87ec-4e815823ade3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:18.396694 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-77659ce2-a7ba-447b-87ec-4e815823ade3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:18.532293 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-77659ce2-a7ba-447b-87ec-4e815823ade3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:18.540877 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-77659ce2-a7ba-447b-87ec-4e815823ade3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:18.542633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-77659ce2-a7ba-447b-87ec-4e815823ade3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:18.543786 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-77659ce2-a7ba-447b-87ec-4e815823ade3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.160610 Jul 25 05:44:18.544346 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 389/765] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:18 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:44:18.810358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-03ab89db-db04-4b0c-af01-0cf6de559dd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:18.810853 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-03ab89db-db04-4b0c-af01-0cf6de559dd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:18.817264 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-03ab89db-db04-4b0c-af01-0cf6de559dd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:18.817713 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-03ab89db-db04-4b0c-af01-0cf6de559dd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:18.818464 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-03ab89db-db04-4b0c-af01-0cf6de559dd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:18.819614 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-03ab89db-db04-4b0c-af01-0cf6de559dd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:18.847674 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-03ab89db-db04-4b0c-af01-0cf6de559dd3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments/c8b4a96d-2402-42b0-91e4-bb72665952d2" status: 200 len: 194 microversion: 2.1 time: 0.041190 Jul 25 05:44:18.848509 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 377/766] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jul 25 05:44:18 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments/c8b4a96d-2402-42b0-91e4-bb72665952d2 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:18.858823 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9fec60e7-95a4-4488-8cf0-54ee3a8af57b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:18.859320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-9fec60e7-95a4-4488-8cf0-54ee3a8af57b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:18.865318 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9fec60e7-95a4-4488-8cf0-54ee3a8af57b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:18.865766 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9fec60e7-95a4-4488-8cf0-54ee3a8af57b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:18.866702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9fec60e7-95a4-4488-8cf0-54ee3a8af57b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:18.867174 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9fec60e7-95a4-4488-8cf0-54ee3a8af57b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:18.945107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-9fec60e7-95a4-4488-8cf0-54ee3a8af57b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lazy-loading 'services' on Instance uuid 4d3a0531-7a5e-4b9c-bb23-5079be9a101d {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:44:19.015906 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-9fec60e7-95a4-4488-8cf0-54ee3a8af57b tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments/c8b4a96d-2402-42b0-91e4-bb72665952d2" status: 202 len: 0 microversion: 2.1 time: 0.160768 Jul 25 05:44:19.016495 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 390/767] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:44:18 2022] DELETE /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments/c8b4a96d-2402-42b0-91e4-bb72665952d2 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:44:19.561563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fc2cbe12-83ed-442d-aaf4-5a8ddc52ad9c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:19.562207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fc2cbe12-83ed-442d-aaf4-5a8ddc52ad9c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:19.568462 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fc2cbe12-83ed-442d-aaf4-5a8ddc52ad9c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:19.569568 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fc2cbe12-83ed-442d-aaf4-5a8ddc52ad9c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:19.570325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fc2cbe12-83ed-442d-aaf4-5a8ddc52ad9c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:19.570758 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fc2cbe12-83ed-442d-aaf4-5a8ddc52ad9c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:19.718792 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fc2cbe12-83ed-442d-aaf4-5a8ddc52ad9c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:19.727545 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fc2cbe12-83ed-442d-aaf4-5a8ddc52ad9c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:19.729087 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fc2cbe12-83ed-442d-aaf4-5a8ddc52ad9c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:19.730268 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fc2cbe12-83ed-442d-aaf4-5a8ddc52ad9c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.172529 Jul 25 05:44:19.730841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 378/768] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:19 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:20.181930 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-974938ef-a2f8-4f16-a2e0-9558f33b08bd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:20.183012 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-974938ef-a2f8-4f16-a2e0-9558f33b08bd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:20.189626 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-974938ef-a2f8-4f16-a2e0-9558f33b08bd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:20.190618 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-974938ef-a2f8-4f16-a2e0-9558f33b08bd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:20.191395 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-974938ef-a2f8-4f16-a2e0-9558f33b08bd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:20.191867 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-974938ef-a2f8-4f16-a2e0-9558f33b08bd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:20.222160 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-974938ef-a2f8-4f16-a2e0-9558f33b08bd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045413 Jul 25 05:44:20.222673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 391/769] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:20 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 05:44:20.330269 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1a3f589a-c903-4097-b745-670ca8c19ebd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:20.331595 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1a3f589a-c903-4097-b745-670ca8c19ebd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:20.339814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a3f589a-c903-4097-b745-670ca8c19ebd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:20.340275 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a3f589a-c903-4097-b745-670ca8c19ebd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:20.341170 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a3f589a-c903-4097-b745-670ca8c19ebd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:20.341640 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a3f589a-c903-4097-b745-670ca8c19ebd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:20.371622 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1a3f589a-c903-4097-b745-670ca8c19ebd tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045957 Jul 25 05:44:20.372172 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 379/770] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:20 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 05:44:20.430955 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2d450e90-6877-41a2-b97a-81dbbfa03ab8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:20.431458 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2d450e90-6877-41a2-b97a-81dbbfa03ab8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:20.437442 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2d450e90-6877-41a2-b97a-81dbbfa03ab8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:20.437892 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2d450e90-6877-41a2-b97a-81dbbfa03ab8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:20.438664 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2d450e90-6877-41a2-b97a-81dbbfa03ab8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:20.439112 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2d450e90-6877-41a2-b97a-81dbbfa03ab8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:20.443177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:44:20.467444 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2d450e90-6877-41a2-b97a-81dbbfa03ab8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Going to try to terminate instance {{(pid=124467) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:44:20.542760 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2d450e90-6877-41a2-b97a-81dbbfa03ab8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 204 len: 0 microversion: 2.1 time: 0.116024 Jul 25 05:44:20.543498 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 392/771] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:44:20 2022] DELETE /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:44:20.552472 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c3b70f12-80d8-4c10-b4fc-02f65196b1d9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:20.553673 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c3b70f12-80d8-4c10-b4fc-02f65196b1d9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:20.559614 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3b70f12-80d8-4c10-b4fc-02f65196b1d9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:20.560069 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3b70f12-80d8-4c10-b4fc-02f65196b1d9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:20.560839 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3b70f12-80d8-4c10-b4fc-02f65196b1d9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:20.561276 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3b70f12-80d8-4c10-b4fc-02f65196b1d9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:20.691741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c3b70f12-80d8-4c10-b4fc-02f65196b1d9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:20.695255 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:44:20.700340 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c3b70f12-80d8-4c10-b4fc-02f65196b1d9 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1670 microversion: 2.1 time: 0.151729 Jul 25 05:44:20.700926 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 380/772] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:20 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:20.748865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-58819b4c-3b8e-452b-8979-6eb22b002dd4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:20.749565 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-58819b4c-3b8e-452b-8979-6eb22b002dd4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:20.755593 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-58819b4c-3b8e-452b-8979-6eb22b002dd4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:20.756038 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-58819b4c-3b8e-452b-8979-6eb22b002dd4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:20.757566 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-58819b4c-3b8e-452b-8979-6eb22b002dd4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:20.757998 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-58819b4c-3b8e-452b-8979-6eb22b002dd4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:20.899628 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-58819b4c-3b8e-452b-8979-6eb22b002dd4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:20.907398 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-58819b4c-3b8e-452b-8979-6eb22b002dd4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:20.908939 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-58819b4c-3b8e-452b-8979-6eb22b002dd4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:20.910145 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-58819b4c-3b8e-452b-8979-6eb22b002dd4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.165663 Jul 25 05:44:20.910700 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 393/773] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:20 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:21.718990 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-507eca73-3fe0-4e34-ba14-cb9ba96ab5d0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:21.719666 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-507eca73-3fe0-4e34-ba14-cb9ba96ab5d0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:21.727510 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-507eca73-3fe0-4e34-ba14-cb9ba96ab5d0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:21.727972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-507eca73-3fe0-4e34-ba14-cb9ba96ab5d0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:21.728746 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-507eca73-3fe0-4e34-ba14-cb9ba96ab5d0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:21.729880 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-507eca73-3fe0-4e34-ba14-cb9ba96ab5d0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:21.864479 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-507eca73-3fe0-4e34-ba14-cb9ba96ab5d0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:21.873047 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-507eca73-3fe0-4e34-ba14-cb9ba96ab5d0 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1670 microversion: 2.1 time: 0.158217 Jul 25 05:44:21.873625 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 381/774] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:21 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:21.928762 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4c1b7aa1-a98d-4825-a538-16bff80c2e39 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:21.929526 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4c1b7aa1-a98d-4825-a538-16bff80c2e39 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:21.936107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4c1b7aa1-a98d-4825-a538-16bff80c2e39 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:21.936645 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4c1b7aa1-a98d-4825-a538-16bff80c2e39 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:21.937509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4c1b7aa1-a98d-4825-a538-16bff80c2e39 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:21.938023 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4c1b7aa1-a98d-4825-a538-16bff80c2e39 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:22.110880 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4c1b7aa1-a98d-4825-a538-16bff80c2e39 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:22.119685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4c1b7aa1-a98d-4825-a538-16bff80c2e39 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:22.121231 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4c1b7aa1-a98d-4825-a538-16bff80c2e39 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:22.122389 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4c1b7aa1-a98d-4825-a538-16bff80c2e39 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.197994 Jul 25 05:44:22.122944 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 394/775] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:21 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:22.891388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-959094e0-eebf-4b83-b5fe-91f441be5504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:22.892625 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-959094e0-eebf-4b83-b5fe-91f441be5504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:22.899356 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-959094e0-eebf-4b83-b5fe-91f441be5504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:22.899805 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-959094e0-eebf-4b83-b5fe-91f441be5504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:22.900734 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-959094e0-eebf-4b83-b5fe-91f441be5504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:22.901222 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-959094e0-eebf-4b83-b5fe-91f441be5504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:23.041923 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-959094e0-eebf-4b83-b5fe-91f441be5504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:23.050503 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-959094e0-eebf-4b83-b5fe-91f441be5504 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1670 microversion: 2.1 time: 0.162960 Jul 25 05:44:23.051333 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 382/776] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:22 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:23.144206 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6f92b2f9-bb45-4cf0-9e4b-fd0bfe1a4e78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:23.145666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6f92b2f9-bb45-4cf0-9e4b-fd0bfe1a4e78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:23.153017 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6f92b2f9-bb45-4cf0-9e4b-fd0bfe1a4e78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:23.153575 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6f92b2f9-bb45-4cf0-9e4b-fd0bfe1a4e78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:23.154404 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6f92b2f9-bb45-4cf0-9e4b-fd0bfe1a4e78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:23.154907 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6f92b2f9-bb45-4cf0-9e4b-fd0bfe1a4e78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:23.317107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6f92b2f9-bb45-4cf0-9e4b-fd0bfe1a4e78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:23.327164 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6f92b2f9-bb45-4cf0-9e4b-fd0bfe1a4e78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:23.328664 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6f92b2f9-bb45-4cf0-9e4b-fd0bfe1a4e78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:23.330429 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6f92b2f9-bb45-4cf0-9e4b-fd0bfe1a4e78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.190853 Jul 25 05:44:23.331314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 395/777] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:23 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:23.483897 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-541a1b46-d1e1-40c6-a752-b63d982886e4 req-80f7a4cf-fddb-480b-a3af-edea15b4563d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3a0531-7a5e-4b9c-bb23-5079be9a101d", "name": "network-vif-deleted", "tag": "7bfd86de-8081-4beb-baeb-694e95587519"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:23.498640 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-541a1b46-d1e1-40c6-a752-b63d982886e4 req-80f7a4cf-fddb-480b-a3af-edea15b4563d service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:23.499571 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-541a1b46-d1e1-40c6-a752-b63d982886e4 req-80f7a4cf-fddb-480b-a3af-edea15b4563d service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:23.514273 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-541a1b46-d1e1-40c6-a752-b63d982886e4 req-80f7a4cf-fddb-480b-a3af-edea15b4563d service nova] Creating event network-vif-deleted:7bfd86de-8081-4beb-baeb-694e95587519 for instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d on hv-cinder-85083 Jul 25 05:44:23.519931 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-541a1b46-d1e1-40c6-a752-b63d982886e4 req-80f7a4cf-fddb-480b-a3af-edea15b4563d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039839 Jul 25 05:44:23.521523 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 383/778] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:24.067865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-52f469e6-a10c-4b8b-a168-2ddc0fdbb5ee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:24.069103 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-52f469e6-a10c-4b8b-a168-2ddc0fdbb5ee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:24.077340 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-52f469e6-a10c-4b8b-a168-2ddc0fdbb5ee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:24.077798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-52f469e6-a10c-4b8b-a168-2ddc0fdbb5ee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:24.078849 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-52f469e6-a10c-4b8b-a168-2ddc0fdbb5ee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:24.079288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-52f469e6-a10c-4b8b-a168-2ddc0fdbb5ee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:24.120574 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-52f469e6-a10c-4b8b-a168-2ddc0fdbb5ee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:24.121047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-52f469e6-a10c-4b8b-a168-2ddc0fdbb5ee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:24.121712 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-52f469e6-a10c-4b8b-a168-2ddc0fdbb5ee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lazy-loading 'fault' on Instance uuid 4d3a0531-7a5e-4b9c-bb23-5079be9a101d {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:44:24.176241 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-52f469e6-a10c-4b8b-a168-2ddc0fdbb5ee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ae82a1862048cb9038b7c76190da8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b7d41e75df46f28cebff70c16d4750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:24.185969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-52f469e6-a10c-4b8b-a168-2ddc0fdbb5ee tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 200 len: 1326 microversion: 2.1 time: 0.121935 Jul 25 05:44:24.186652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 396/779] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:24 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:44:24.351000 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8e1fd888-9cb1-4feb-8457-739570085995 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:24.352535 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8e1fd888-9cb1-4feb-8457-739570085995 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:24.359297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8e1fd888-9cb1-4feb-8457-739570085995 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:24.359997 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8e1fd888-9cb1-4feb-8457-739570085995 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:24.361505 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8e1fd888-9cb1-4feb-8457-739570085995 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:24.361950 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8e1fd888-9cb1-4feb-8457-739570085995 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:24.513240 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8e1fd888-9cb1-4feb-8457-739570085995 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:24.521583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8e1fd888-9cb1-4feb-8457-739570085995 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:24.523150 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8e1fd888-9cb1-4feb-8457-739570085995 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:24.524503 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8e1fd888-9cb1-4feb-8457-739570085995 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1742 microversion: 2.20 time: 0.178912 Jul 25 05:44:24.528873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 384/780] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:24 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1742 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:25.203643 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4f71d3b9-71a7-44b9-a124-805245241ebb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:25.204253 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4f71d3b9-71a7-44b9-a124-805245241ebb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:25.211504 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f71d3b9-71a7-44b9-a124-805245241ebb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:25.211958 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f71d3b9-71a7-44b9-a124-805245241ebb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:25.212720 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f71d3b9-71a7-44b9-a124-805245241ebb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:25.213184 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4f71d3b9-71a7-44b9-a124-805245241ebb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:25.226849 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-4f71d3b9-71a7-44b9-a124-805245241ebb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] HTTP exception thrown: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4f71d3b9-71a7-44b9-a124-805245241ebb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Request method failure captured: Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d HTTP/1.1 Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3ixeU81EgFXlKh7Hp_fPTjofLKlA_grfgGFOsVR7V0Vy1Eew77MrsJvX_brgqZAZFs3_tH2uFzao_ltFj_e47Ammmd12lT7srFPlu7vMaHUNGiS21hpevq0t1NKjr51YZPl2StrqjfEMPMmxiZsJ-54lO9uorRvAHRoDHWZ2eZnZLfE Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:44:25.228500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0b7d41e75df46f28cebff70c16d4750"}]}] Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: c1ae82a1862048cb9038b7c76190da8a Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:25.230242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '4d3a0531-7a5e-4b9c-bb23-5079be9a101d'} Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:25.231128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:25.232467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:25.233750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4f71d3b9-71a7-44b9-a124-805245241ebb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Returning 404 to user: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:25.233750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4f71d3b9-71a7-44b9-a124-805245241ebb tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 404 len: 111 microversion: 2.1 time: 0.030175 Jul 25 05:44:25.233750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 397/781] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:25 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:44:25.238936 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6dbe68be-d3a1-4934-acda-f141dfb8e0f3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '.version_select at 0x7fcc844b1700>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:25.255612 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6dbe68be-d3a1-4934-acda-f141dfb8e0f3 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-127944121" status: 202 len: 0 microversion: 2.1 time: 0.020442 Jul 25 05:44:25.256167 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 385/782] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jul 25 05:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-127944121 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:44:25.544033 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-882cb905-05a1-47f8-8523-835bc19377ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:25.544925 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-882cb905-05a1-47f8-8523-835bc19377ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:25.551268 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-882cb905-05a1-47f8-8523-835bc19377ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:25.551923 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-882cb905-05a1-47f8-8523-835bc19377ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:25.552796 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-882cb905-05a1-47f8-8523-835bc19377ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:25.553394 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-882cb905-05a1-47f8-8523-835bc19377ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:25.710070 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-882cb905-05a1-47f8-8523-835bc19377ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:25.718320 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-882cb905-05a1-47f8-8523-835bc19377ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:25.719771 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-882cb905-05a1-47f8-8523-835bc19377ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:25.720980 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-882cb905-05a1-47f8-8523-835bc19377ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1742 microversion: 2.20 time: 0.180932 Jul 25 05:44:25.721732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 398/783] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:25 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:44:26.740010 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-49200c34-4fca-46b7-adad-7f58d09a562f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:26.740658 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-49200c34-4fca-46b7-adad-7f58d09a562f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:26.748135 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49200c34-4fca-46b7-adad-7f58d09a562f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:26.748597 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49200c34-4fca-46b7-adad-7f58d09a562f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:26.749423 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49200c34-4fca-46b7-adad-7f58d09a562f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:26.749900 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49200c34-4fca-46b7-adad-7f58d09a562f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:27.213614 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-49200c34-4fca-46b7-adad-7f58d09a562f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:27.227072 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-49200c34-4fca-46b7-adad-7f58d09a562f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:27.229506 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-49200c34-4fca-46b7-adad-7f58d09a562f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:27.230381 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-49200c34-4fca-46b7-adad-7f58d09a562f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1737 microversion: 2.20 time: 0.494284 Jul 25 05:44:27.231032 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 386/784] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:26 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1737 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:27.526546 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-cc32bd5e-c066-46ab-94af-f6928e05eaef req-75b996e3-137a-4d54-9c83-9a663d0ddaba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb16475-6c9b-4c00-be15-0b5f68b01d0a", "name": "network-vif-plugged", "status": "completed", "tag": "15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:27.541412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-cc32bd5e-c066-46ab-94af-f6928e05eaef req-75b996e3-137a-4d54-9c83-9a663d0ddaba service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:27.542184 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-cc32bd5e-c066-46ab-94af-f6928e05eaef req-75b996e3-137a-4d54-9c83-9a663d0ddaba service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:27.558961 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-cc32bd5e-c066-46ab-94af-f6928e05eaef req-75b996e3-137a-4d54-9c83-9a663d0ddaba service nova] Creating event network-vif-plugged:15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc for instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a on hv-cinder-85083 Jul 25 05:44:27.566461 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-cc32bd5e-c066-46ab-94af-f6928e05eaef req-75b996e3-137a-4d54-9c83-9a663d0ddaba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043664 Jul 25 05:44:27.568650 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 399/785] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:28.253150 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-45ba1720-83fa-490f-8451-df0c1e9266a0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:28.255384 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-45ba1720-83fa-490f-8451-df0c1e9266a0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:28.263291 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45ba1720-83fa-490f-8451-df0c1e9266a0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:28.264104 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45ba1720-83fa-490f-8451-df0c1e9266a0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:28.265518 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45ba1720-83fa-490f-8451-df0c1e9266a0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:28.265973 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45ba1720-83fa-490f-8451-df0c1e9266a0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:28.451732 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-45ba1720-83fa-490f-8451-df0c1e9266a0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:28.463273 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-45ba1720-83fa-490f-8451-df0c1e9266a0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:28.465081 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-45ba1720-83fa-490f-8451-df0c1e9266a0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:28.467091 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-45ba1720-83fa-490f-8451-df0c1e9266a0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1737 microversion: 2.20 time: 0.219529 Jul 25 05:44:28.479795 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 387/786] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:28 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:28.509626 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-19f527a5-898f-4d15-9697-c741dd25e724 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:28.509626 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-19f527a5-898f-4d15-9697-c741dd25e724 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:28.518927 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-19f527a5-898f-4d15-9697-c741dd25e724 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:28.519759 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-19f527a5-898f-4d15-9697-c741dd25e724 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:28.521042 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-19f527a5-898f-4d15-9697-c741dd25e724 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:28.521576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-19f527a5-898f-4d15-9697-c741dd25e724 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:28.548739 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-19f527a5-898f-4d15-9697-c741dd25e724 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] HTTP exception thrown: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-19f527a5-898f-4d15-9697-c741dd25e724 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Request method failure captured: Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: DELETE /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d HTTP/1.1 Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3ixeU81EgFXlKh7Hp_fPTjofLKlA_grfgGFOsVR7V0Vy1Eew77MrsJvX_brgqZAZFs3_tH2uFzao_ltFj_e47Ammmd12lT7srFPlu7vMaHUNGiS21hpevq0t1NKjr51YZPl2StrqjfEMPMmxiZsJ-54lO9uorRvAHRoDHWZ2eZnZLfE Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:44:28.554839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0b7d41e75df46f28cebff70c16d4750"}]}] Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: c1ae82a1862048cb9038b7c76190da8a Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:28.556987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '4d3a0531-7a5e-4b9c-bb23-5079be9a101d'} Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:28.557950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:28.559512 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:28.561048 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-19f527a5-898f-4d15-9697-c741dd25e724 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Returning 404 to user: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:28.562014 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-19f527a5-898f-4d15-9697-c741dd25e724 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 404 len: 111 microversion: 2.1 time: 0.060104 Jul 25 05:44:28.564827 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 400/787] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:44:28 2022] DELETE /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:44:28.572684 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e0df5f8f-a564-423e-af14-3a8aba7c70f8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:28.573766 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e0df5f8f-a564-423e-af14-3a8aba7c70f8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4d3a0531-7a5e-4b9c-bb23-5079be9a101d] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:28.581927 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e0df5f8f-a564-423e-af14-3a8aba7c70f8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:28.582475 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e0df5f8f-a564-423e-af14-3a8aba7c70f8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:28.583624 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e0df5f8f-a564-423e-af14-3a8aba7c70f8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:28.584145 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e0df5f8f-a564-423e-af14-3a8aba7c70f8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:28.599237 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-e0df5f8f-a564-423e-af14-3a8aba7c70f8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] HTTP exception thrown: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e0df5f8f-a564-423e-af14-3a8aba7c70f8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Request method failure captured: Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d HTTP/1.1 Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3ixeU81EgFXlKh7Hp_fPTjofLKlA_grfgGFOsVR7V0Vy1Eew77MrsJvX_brgqZAZFs3_tH2uFzao_ltFj_e47Ammmd12lT7srFPlu7vMaHUNGiS21hpevq0t1NKjr51YZPl2StrqjfEMPMmxiZsJ-54lO9uorRvAHRoDHWZ2eZnZLfE Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:44:28.601280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0b7d41e75df46f28cebff70c16d4750"}]}] Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: c1ae82a1862048cb9038b7c76190da8a Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:28.603618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '4d3a0531-7a5e-4b9c-bb23-5079be9a101d'} Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:28.604708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. Jul 25 05:44:28.607272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:28.608955 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e0df5f8f-a564-423e-af14-3a8aba7c70f8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Returning 404 to user: Instance 4d3a0531-7a5e-4b9c-bb23-5079be9a101d could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:28.608955 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e0df5f8f-a564-423e-af14-3a8aba7c70f8 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d" status: 404 len: 111 microversion: 2.1 time: 0.036190 Jul 25 05:44:28.618500 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 388/788] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:28 2022] GET /compute/v2.1/servers/4d3a0531-7a5e-4b9c-bb23-5079be9a101d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:44:29.486640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-46972c21-2d43-4964-9751-3ab6b3ac8b93 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:29.487568 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-46972c21-2d43-4964-9751-3ab6b3ac8b93 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:29.494703 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46972c21-2d43-4964-9751-3ab6b3ac8b93 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:29.495432 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46972c21-2d43-4964-9751-3ab6b3ac8b93 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:29.496385 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46972c21-2d43-4964-9751-3ab6b3ac8b93 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:29.497258 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46972c21-2d43-4964-9751-3ab6b3ac8b93 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:29.734800 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-46972c21-2d43-4964-9751-3ab6b3ac8b93 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:29.751497 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-46972c21-2d43-4964-9751-3ab6b3ac8b93 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:29.753101 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-46972c21-2d43-4964-9751-3ab6b3ac8b93 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:29.754503 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-46972c21-2d43-4964-9751-3ab6b3ac8b93 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1737 microversion: 2.20 time: 0.271966 Jul 25 05:44:29.755546 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 401/789] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:29 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1737 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:29.795901 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-184729f8-89c8-4b33-9950-908eb7e8d3a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:29.797701 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-184729f8-89c8-4b33-9950-908eb7e8d3a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:29.805493 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-184729f8-89c8-4b33-9950-908eb7e8d3a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:29.806355 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-184729f8-89c8-4b33-9950-908eb7e8d3a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:29.807652 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-184729f8-89c8-4b33-9950-908eb7e8d3a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:29.808326 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-184729f8-89c8-4b33-9950-908eb7e8d3a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:29.825203 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-184729f8-89c8-4b33-9950-908eb7e8d3a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] HTTP exception thrown: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-184729f8-89c8-4b33-9950-908eb7e8d3a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Request method failure captured: Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 HTTP/1.1 Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3ixeU81EgFXlKh7Hp_fPTjofLKlA_grfgGFOsVR7V0Vy1Eew77MrsJvX_brgqZAZFs3_tH2uFzao_ltFj_e47Ammmd12lT7srFPlu7vMaHUNGiS21hpevq0t1NKjr51YZPl2StrqjfEMPMmxiZsJ-54lO9uorRvAHRoDHWZ2eZnZLfE Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:44:29.827442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0b7d41e75df46f28cebff70c16d4750"}]}] Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: c1ae82a1862048cb9038b7c76190da8a Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:44:29.828845 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '4943e050-a915-4850-8e01-9590c5fcde77'} Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:29.829626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:44:29.830873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:29.833914 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-184729f8-89c8-4b33-9950-908eb7e8d3a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Returning 404 to user: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:29.835665 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-184729f8-89c8-4b33-9950-908eb7e8d3a2 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 404 len: 111 microversion: 2.1 time: 0.044910 Jul 25 05:44:29.839539 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 389/790] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:44:29 2022] DELETE /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:44:29.846374 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4d0f70fc-45fb-42a9-b0a7-126b29e9f603 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:29.847281 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4d0f70fc-45fb-42a9-b0a7-126b29e9f603 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] [instance: 4943e050-a915-4850-8e01-9590c5fcde77] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:29.855999 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d0f70fc-45fb-42a9-b0a7-126b29e9f603 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:29.856710 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d0f70fc-45fb-42a9-b0a7-126b29e9f603 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:29.857721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d0f70fc-45fb-42a9-b0a7-126b29e9f603 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:29.858475 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d0f70fc-45fb-42a9-b0a7-126b29e9f603 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:29.877759 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-4d0f70fc-45fb-42a9-b0a7-126b29e9f603 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] HTTP exception thrown: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4d0f70fc-45fb-42a9-b0a7-126b29e9f603 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Request method failure captured: Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 HTTP/1.1 Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3ixeU81EgFXlKh7Hp_fPTjofLKlA_grfgGFOsVR7V0Vy1Eew77MrsJvX_brgqZAZFs3_tH2uFzao_ltFj_e47Ammmd12lT7srFPlu7vMaHUNGiS21hpevq0t1NKjr51YZPl2StrqjfEMPMmxiZsJ-54lO9uorRvAHRoDHWZ2eZnZLfE Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:44:29.879420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0b7d41e75df46f28cebff70c16d4750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0b7d41e75df46f28cebff70c16d4750"}]}] Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: f0b7d41e75df46f28cebff70c16d4750 Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1806798430 Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: c1ae82a1862048cb9038b7c76190da8a Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeTestJSON-1806798430-project Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:44:29.881047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '4943e050-a915-4850-8e01-9590c5fcde77'} Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:29.882055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. Jul 25 05:44:29.883696 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:44:29.885109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4d0f70fc-45fb-42a9-b0a7-126b29e9f603 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] Returning 404 to user: Instance 4943e050-a915-4850-8e01-9590c5fcde77 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:29.885109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4d0f70fc-45fb-42a9-b0a7-126b29e9f603 tempest-AttachVolumeTestJSON-1806798430 tempest-AttachVolumeTestJSON-1806798430-project] 10.222.0.33 "GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77" status: 404 len: 111 microversion: 2.1 time: 0.040445 Jul 25 05:44:29.885109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 402/791] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:44:29 2022] GET /compute/v2.1/servers/4943e050-a915-4850-8e01-9590c5fcde77 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:44:30.776970 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8b087a1d-28de-4cf5-b9b4-2a58b68fc7c8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:30.777590 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8b087a1d-28de-4cf5-b9b4-2a58b68fc7c8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:30.790534 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8b087a1d-28de-4cf5-b9b4-2a58b68fc7c8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:30.791206 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8b087a1d-28de-4cf5-b9b4-2a58b68fc7c8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:30.792196 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8b087a1d-28de-4cf5-b9b4-2a58b68fc7c8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:30.792825 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8b087a1d-28de-4cf5-b9b4-2a58b68fc7c8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:31.003984 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8b087a1d-28de-4cf5-b9b4-2a58b68fc7c8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:31.014090 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8b087a1d-28de-4cf5-b9b4-2a58b68fc7c8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:31.016956 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8b087a1d-28de-4cf5-b9b4-2a58b68fc7c8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:31.018982 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8b087a1d-28de-4cf5-b9b4-2a58b68fc7c8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1737 microversion: 2.20 time: 0.246805 Jul 25 05:44:31.020018 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 390/792] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:30 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:32.038407 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4d0200c0-eeb5-46e8-890d-09ca2810d091 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:32.039052 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4d0200c0-eeb5-46e8-890d-09ca2810d091 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:32.048161 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d0200c0-eeb5-46e8-890d-09ca2810d091 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:32.050003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d0200c0-eeb5-46e8-890d-09ca2810d091 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:32.053260 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d0200c0-eeb5-46e8-890d-09ca2810d091 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:32.055436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4d0200c0-eeb5-46e8-890d-09ca2810d091 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:32.281897 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4d0200c0-eeb5-46e8-890d-09ca2810d091 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:32.291241 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4d0200c0-eeb5-46e8-890d-09ca2810d091 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:32.293318 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4d0200c0-eeb5-46e8-890d-09ca2810d091 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:32.295103 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4d0200c0-eeb5-46e8-890d-09ca2810d091 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1737 microversion: 2.20 time: 0.261022 Jul 25 05:44:32.295817 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 403/793] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:32 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1737 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:33.321272 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-73523341-c7cf-42a5-b271-931acee97863 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:33.322496 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-73523341-c7cf-42a5-b271-931acee97863 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:33.337188 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-73523341-c7cf-42a5-b271-931acee97863 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:33.337646 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-73523341-c7cf-42a5-b271-931acee97863 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:33.339542 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-73523341-c7cf-42a5-b271-931acee97863 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:33.342429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-73523341-c7cf-42a5-b271-931acee97863 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:33.588564 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-73523341-c7cf-42a5-b271-931acee97863 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:33.601181 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-73523341-c7cf-42a5-b271-931acee97863 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:33.602820 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-73523341-c7cf-42a5-b271-931acee97863 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:33.607711 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-73523341-c7cf-42a5-b271-931acee97863 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1737 microversion: 2.20 time: 0.293828 Jul 25 05:44:33.608636 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 391/794] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:33 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:34.625733 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-050e2d32-7763-4a6a-acd1-2fd0772ac7b8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:34.626347 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-050e2d32-7763-4a6a-acd1-2fd0772ac7b8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:34.637967 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-050e2d32-7763-4a6a-acd1-2fd0772ac7b8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:34.640972 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-050e2d32-7763-4a6a-acd1-2fd0772ac7b8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:34.641794 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-050e2d32-7763-4a6a-acd1-2fd0772ac7b8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:34.642339 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-050e2d32-7763-4a6a-acd1-2fd0772ac7b8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:34.823997 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-050e2d32-7763-4a6a-acd1-2fd0772ac7b8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:34.839370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-050e2d32-7763-4a6a-acd1-2fd0772ac7b8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:34.842971 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-050e2d32-7763-4a6a-acd1-2fd0772ac7b8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:34.845564 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-050e2d32-7763-4a6a-acd1-2fd0772ac7b8 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1737 microversion: 2.20 time: 0.223558 Jul 25 05:44:34.859521 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 404/795] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:34 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:35.867033 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-516970d3-328d-4f67-8cb9-561dd3a4d036 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:35.867663 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-516970d3-328d-4f67-8cb9-561dd3a4d036 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:35.876517 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-516970d3-328d-4f67-8cb9-561dd3a4d036 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:35.877778 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-516970d3-328d-4f67-8cb9-561dd3a4d036 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:35.879607 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-516970d3-328d-4f67-8cb9-561dd3a4d036 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:35.879974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-516970d3-328d-4f67-8cb9-561dd3a4d036 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:36.040746 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-516970d3-328d-4f67-8cb9-561dd3a4d036 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:36.048904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-516970d3-328d-4f67-8cb9-561dd3a4d036 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:36.050434 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-516970d3-328d-4f67-8cb9-561dd3a4d036 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:36.051604 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-516970d3-328d-4f67-8cb9-561dd3a4d036 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1737 microversion: 2.20 time: 0.188685 Jul 25 05:44:36.054536 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 392/796] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:35 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:37.072552 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3ca59792-3e47-41f1-8a91-4ca16dde173e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:37.073188 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3ca59792-3e47-41f1-8a91-4ca16dde173e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:37.086617 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:44:37.088531 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3ca59792-3e47-41f1-8a91-4ca16dde173e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:37.089133 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3ca59792-3e47-41f1-8a91-4ca16dde173e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:37.089974 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3ca59792-3e47-41f1-8a91-4ca16dde173e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:37.090464 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3ca59792-3e47-41f1-8a91-4ca16dde173e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:37.312439 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3ca59792-3e47-41f1-8a91-4ca16dde173e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:37.323316 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3ca59792-3e47-41f1-8a91-4ca16dde173e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:37.325012 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3ca59792-3e47-41f1-8a91-4ca16dde173e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:37.326353 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3ca59792-3e47-41f1-8a91-4ca16dde173e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1737 microversion: 2.20 time: 0.258061 Jul 25 05:44:37.327257 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 405/797] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:37 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:38.346093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-17bea5a5-a300-493a-89b1-c993ed898cfb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:38.346904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-17bea5a5-a300-493a-89b1-c993ed898cfb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:38.349864 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:44:38.355787 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17bea5a5-a300-493a-89b1-c993ed898cfb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:38.356330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17bea5a5-a300-493a-89b1-c993ed898cfb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:38.357226 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17bea5a5-a300-493a-89b1-c993ed898cfb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:38.357726 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17bea5a5-a300-493a-89b1-c993ed898cfb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:38.509715 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-17bea5a5-a300-493a-89b1-c993ed898cfb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:38.520114 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-17bea5a5-a300-493a-89b1-c993ed898cfb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:38.521776 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-17bea5a5-a300-493a-89b1-c993ed898cfb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:38.523936 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-17bea5a5-a300-493a-89b1-c993ed898cfb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1737 microversion: 2.20 time: 0.181881 Jul 25 05:44:38.524522 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 393/798] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:38 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:39.542773 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b6c1e6ff-599b-43fa-a9e3-27e198b628d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:39.543392 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b6c1e6ff-599b-43fa-a9e3-27e198b628d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:39.550024 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b6c1e6ff-599b-43fa-a9e3-27e198b628d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:39.550501 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b6c1e6ff-599b-43fa-a9e3-27e198b628d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:39.551264 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b6c1e6ff-599b-43fa-a9e3-27e198b628d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:39.551704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b6c1e6ff-599b-43fa-a9e3-27e198b628d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:39.691854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b6c1e6ff-599b-43fa-a9e3-27e198b628d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:39.701456 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b6c1e6ff-599b-43fa-a9e3-27e198b628d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:39.703390 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b6c1e6ff-599b-43fa-a9e3-27e198b628d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:39.704540 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b6c1e6ff-599b-43fa-a9e3-27e198b628d1 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1719 microversion: 2.20 time: 0.166671 Jul 25 05:44:39.708832 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 406/799] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:39 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:40.723502 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2034f5e7-2bcb-4398-92fb-605f2524b1f7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:40.724380 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2034f5e7-2bcb-4398-92fb-605f2524b1f7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:40.731675 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2034f5e7-2bcb-4398-92fb-605f2524b1f7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:40.732130 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2034f5e7-2bcb-4398-92fb-605f2524b1f7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:40.732924 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2034f5e7-2bcb-4398-92fb-605f2524b1f7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:40.733365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2034f5e7-2bcb-4398-92fb-605f2524b1f7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:40.878466 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2034f5e7-2bcb-4398-92fb-605f2524b1f7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:40.887234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2034f5e7-2bcb-4398-92fb-605f2524b1f7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:40.888825 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2034f5e7-2bcb-4398-92fb-605f2524b1f7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:40.890303 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2034f5e7-2bcb-4398-92fb-605f2524b1f7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1719 microversion: 2.20 time: 0.170345 Jul 25 05:44:40.890459 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 394/800] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:40 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:41.909316 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2bb3bab2-52cf-44d6-be31-d8fe905dfe76 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:41.909872 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2bb3bab2-52cf-44d6-be31-d8fe905dfe76 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:41.917051 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2bb3bab2-52cf-44d6-be31-d8fe905dfe76 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:41.917504 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2bb3bab2-52cf-44d6-be31-d8fe905dfe76 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:41.918266 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2bb3bab2-52cf-44d6-be31-d8fe905dfe76 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:41.918702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2bb3bab2-52cf-44d6-be31-d8fe905dfe76 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:42.050592 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2bb3bab2-52cf-44d6-be31-d8fe905dfe76 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:42.058609 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2bb3bab2-52cf-44d6-be31-d8fe905dfe76 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:42.060127 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2bb3bab2-52cf-44d6-be31-d8fe905dfe76 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:42.061340 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2bb3bab2-52cf-44d6-be31-d8fe905dfe76 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1719 microversion: 2.20 time: 0.156162 Jul 25 05:44:42.061902 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 407/801] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:41 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:43.079595 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8bb52319-c4ae-48b0-9076-3121005c2861 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:43.080122 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8bb52319-c4ae-48b0-9076-3121005c2861 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:43.086683 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8bb52319-c4ae-48b0-9076-3121005c2861 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:43.087368 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8bb52319-c4ae-48b0-9076-3121005c2861 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:43.088229 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8bb52319-c4ae-48b0-9076-3121005c2861 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:43.088676 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8bb52319-c4ae-48b0-9076-3121005c2861 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:43.222456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8bb52319-c4ae-48b0-9076-3121005c2861 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:43.231366 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8bb52319-c4ae-48b0-9076-3121005c2861 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:43.232898 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8bb52319-c4ae-48b0-9076-3121005c2861 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:43.234050 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8bb52319-c4ae-48b0-9076-3121005c2861 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1719 microversion: 2.20 time: 0.158488 Jul 25 05:44:43.234686 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 395/802] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:43 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:44.252126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e396464b-31f7-4153-bb1e-7cc76b3094f6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:44.252742 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e396464b-31f7-4153-bb1e-7cc76b3094f6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:44.259817 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e396464b-31f7-4153-bb1e-7cc76b3094f6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:44.260439 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e396464b-31f7-4153-bb1e-7cc76b3094f6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:44.261369 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e396464b-31f7-4153-bb1e-7cc76b3094f6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:44.261984 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e396464b-31f7-4153-bb1e-7cc76b3094f6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:44.405662 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e396464b-31f7-4153-bb1e-7cc76b3094f6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:44.413791 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e396464b-31f7-4153-bb1e-7cc76b3094f6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:44.415917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e396464b-31f7-4153-bb1e-7cc76b3094f6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:44.416721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e396464b-31f7-4153-bb1e-7cc76b3094f6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1722 microversion: 2.20 time: 0.168473 Jul 25 05:44:44.417315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 408/803] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:44 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:44:44.434638 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a1d82f97-dd28-474f-ba41-3f38215eb7dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4603155-f7ef-42d2-b92c-04fbb535a60c"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:44.435726 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a1d82f97-dd28-474f-ba41-3f38215eb7dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:44.442484 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a1d82f97-dd28-474f-ba41-3f38215eb7dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:44.442960 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a1d82f97-dd28-474f-ba41-3f38215eb7dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:44.443741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a1d82f97-dd28-474f-ba41-3f38215eb7dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:44.444192 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a1d82f97-dd28-474f-ba41-3f38215eb7dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:44.782206 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a1d82f97-dd28-474f-ba41-3f38215eb7dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "POST /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.351747 Jul 25 05:44:44.782925 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 396/804] 10.222.0.33 () {62 vars in 1363 bytes} [Mon Jul 25 05:44:44 2022] POST /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments => generated 188 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:44:44.838874 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-89f5fed9-942e-490f-92f7-269f35ef92e8 req-66328b38-9957-44c1-a3a5-8d862b3c924e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb16475-6c9b-4c00-be15-0b5f68b01d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:44.849982 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-89f5fed9-942e-490f-92f7-269f35ef92e8 req-66328b38-9957-44c1-a3a5-8d862b3c924e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:44.850558 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-89f5fed9-942e-490f-92f7-269f35ef92e8 req-66328b38-9957-44c1-a3a5-8d862b3c924e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:44.863648 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.compute.server_external_events [req-89f5fed9-942e-490f-92f7-269f35ef92e8 req-66328b38-9957-44c1-a3a5-8d862b3c924e service nova] Unable to find a host for instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a. Dropping event network-vif-unplugged {{(pid=124467) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 05:44:44.865400 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-89f5fed9-942e-490f-92f7-269f35ef92e8 req-66328b38-9957-44c1-a3a5-8d862b3c924e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031162 Jul 25 05:44:44.867054 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 409/805] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 05:44:44.937243 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c49682b2-e432-4442-8a7f-78a4bfc3dcc2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:44.937870 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c49682b2-e432-4442-8a7f-78a4bfc3dcc2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:44.945358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c49682b2-e432-4442-8a7f-78a4bfc3dcc2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:44.945813 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c49682b2-e432-4442-8a7f-78a4bfc3dcc2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:44.947396 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c49682b2-e432-4442-8a7f-78a4bfc3dcc2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:44.947841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c49682b2-e432-4442-8a7f-78a4bfc3dcc2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:44.998764 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:44:45.050623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c49682b2-e432-4442-8a7f-78a4bfc3dcc2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "POST /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/action" status: 202 len: 0 microversion: 2.20 time: 0.118025 Jul 25 05:44:45.051526 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 397/806] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jul 25 05:44:44 2022] POST /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 05:44:45.060904 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-28dd9afc-eab4-4103-8756-6e95b1f3d9c2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:45.061519 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-28dd9afc-eab4-4103-8756-6e95b1f3d9c2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:45.067863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-28dd9afc-eab4-4103-8756-6e95b1f3d9c2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:45.068323 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-28dd9afc-eab4-4103-8756-6e95b1f3d9c2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:45.069296 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-28dd9afc-eab4-4103-8756-6e95b1f3d9c2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:45.069740 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-28dd9afc-eab4-4103-8756-6e95b1f3d9c2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:45.075391 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:44:45.237126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-28dd9afc-eab4-4103-8756-6e95b1f3d9c2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:45.247311 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-28dd9afc-eab4-4103-8756-6e95b1f3d9c2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:45.249094 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-28dd9afc-eab4-4103-8756-6e95b1f3d9c2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:45.250676 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-28dd9afc-eab4-4103-8756-6e95b1f3d9c2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1748 microversion: 2.20 time: 0.195159 Jul 25 05:44:45.251460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 410/807] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:45 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1748 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:46.270282 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d4d5c972-94f3-4b43-a924-6cd10529e5ab tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:46.270974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d4d5c972-94f3-4b43-a924-6cd10529e5ab tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:46.277988 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4d5c972-94f3-4b43-a924-6cd10529e5ab tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:46.278445 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4d5c972-94f3-4b43-a924-6cd10529e5ab tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:46.279210 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4d5c972-94f3-4b43-a924-6cd10529e5ab tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:46.279679 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4d5c972-94f3-4b43-a924-6cd10529e5ab tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:46.423999 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d4d5c972-94f3-4b43-a924-6cd10529e5ab tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:46.433724 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d4d5c972-94f3-4b43-a924-6cd10529e5ab tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:46.435352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d4d5c972-94f3-4b43-a924-6cd10529e5ab tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:46.436618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d4d5c972-94f3-4b43-a924-6cd10529e5ab tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1750 microversion: 2.20 time: 0.170329 Jul 25 05:44:46.437207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 398/808] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:46 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:47.455070 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4a97b2b0-757d-46fc-ac30-24edad763f55 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:47.455670 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4a97b2b0-757d-46fc-ac30-24edad763f55 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:47.462822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4a97b2b0-757d-46fc-ac30-24edad763f55 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:47.463392 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4a97b2b0-757d-46fc-ac30-24edad763f55 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:47.464177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4a97b2b0-757d-46fc-ac30-24edad763f55 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:47.464611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4a97b2b0-757d-46fc-ac30-24edad763f55 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:47.586654 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7265881e-7862-4ed0-9dc6-e1e16f533105 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1191967470"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:47.588575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7265881e-7862-4ed0-9dc6-e1e16f533105 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:47.594873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7265881e-7862-4ed0-9dc6-e1e16f533105 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:47.595394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7265881e-7862-4ed0-9dc6-e1e16f533105 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:47.597164 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4a97b2b0-757d-46fc-ac30-24edad763f55 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:47.597400 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7265881e-7862-4ed0-9dc6-e1e16f533105 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:47.597913 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7265881e-7862-4ed0-9dc6-e1e16f533105 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:47.607289 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4a97b2b0-757d-46fc-ac30-24edad763f55 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:47.608802 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4a97b2b0-757d-46fc-ac30-24edad763f55 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:47.609956 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4a97b2b0-757d-46fc-ac30-24edad763f55 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.158828 Jul 25 05:44:47.610527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 411/809] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:47 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:47.777119 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.network.security_group_api [None req-7265881e-7862-4ed0-9dc6-e1e16f533105 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Removing security group 182d468d-0d4d-48aa-9fb2-39ecd2e1bb05 from port 8a836452-7655-49c8-9aaf-c2441440165f Jul 25 05:44:48.190755 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7265881e-7862-4ed0-9dc6-e1e16f533105 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "POST /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/action" status: 202 len: 0 microversion: 2.1 time: 0.608045 Jul 25 05:44:48.191335 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 399/810] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:44:47 2022] POST /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 05:44:48.204678 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-48ce1447-0290-4c2e-bb05-1cf1229bfa99 req-dfed1cce-3d44-4b94-90c1-595d62dd40c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a30608a-b03b-41fb-95be-6ba3eba17562", "tag": "8a836452-7655-49c8-9aaf-c2441440165f"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:48.216680 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-48ce1447-0290-4c2e-bb05-1cf1229bfa99 req-dfed1cce-3d44-4b94-90c1-595d62dd40c4 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:48.217160 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-48ce1447-0290-4c2e-bb05-1cf1229bfa99 req-dfed1cce-3d44-4b94-90c1-595d62dd40c4 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:48.254164 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-48ce1447-0290-4c2e-bb05-1cf1229bfa99 req-dfed1cce-3d44-4b94-90c1-595d62dd40c4 service nova] Creating event network-changed:8a836452-7655-49c8-9aaf-c2441440165f for instance 5a30608a-b03b-41fb-95be-6ba3eba17562 on hv-cinder-85083 Jul 25 05:44:48.259905 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-48ce1447-0290-4c2e-bb05-1cf1229bfa99 req-dfed1cce-3d44-4b94-90c1-595d62dd40c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058938 Jul 25 05:44:48.261230 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 412/811] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:48.633828 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1eee3e7f-d0ca-4683-835a-879b703704c4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:48.637489 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1eee3e7f-d0ca-4683-835a-879b703704c4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:48.651341 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1eee3e7f-d0ca-4683-835a-879b703704c4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:48.652199 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1eee3e7f-d0ca-4683-835a-879b703704c4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:48.653239 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1eee3e7f-d0ca-4683-835a-879b703704c4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:48.654650 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1eee3e7f-d0ca-4683-835a-879b703704c4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:48.918192 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1eee3e7f-d0ca-4683-835a-879b703704c4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:48.940836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1eee3e7f-d0ca-4683-835a-879b703704c4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:48.943375 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1eee3e7f-d0ca-4683-835a-879b703704c4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:48.944963 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1eee3e7f-d0ca-4683-835a-879b703704c4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.318297 Jul 25 05:44:48.958237 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 400/812] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:48 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:44:49.969206 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6eb0bcb4-3159-4977-8762-97b9cff0cb3d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:49.970674 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6eb0bcb4-3159-4977-8762-97b9cff0cb3d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:49.984411 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6eb0bcb4-3159-4977-8762-97b9cff0cb3d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:49.985124 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6eb0bcb4-3159-4977-8762-97b9cff0cb3d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:49.986213 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6eb0bcb4-3159-4977-8762-97b9cff0cb3d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:49.986900 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6eb0bcb4-3159-4977-8762-97b9cff0cb3d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:50.323298 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6eb0bcb4-3159-4977-8762-97b9cff0cb3d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:50.334454 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6eb0bcb4-3159-4977-8762-97b9cff0cb3d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:50.336180 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6eb0bcb4-3159-4977-8762-97b9cff0cb3d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:50.342395 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6eb0bcb4-3159-4977-8762-97b9cff0cb3d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.380670 Jul 25 05:44:50.343408 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 413/813] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:49 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:50.375550 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8f5b44a5-46ad-4a5c-b683-3cd5d621b549 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:50.376887 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8f5b44a5-46ad-4a5c-b683-3cd5d621b549 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:50.389221 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f5b44a5-46ad-4a5c-b683-3cd5d621b549 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:50.390371 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f5b44a5-46ad-4a5c-b683-3cd5d621b549 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:50.392022 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f5b44a5-46ad-4a5c-b683-3cd5d621b549 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:50.392938 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f5b44a5-46ad-4a5c-b683-3cd5d621b549 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:50.399550 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-c0213590-1c69-4a2d-92e9-3c91264b2e70 req-c99fb798-5319-4f19-b0c4-55e4449af0af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a30608a-b03b-41fb-95be-6ba3eba17562", "tag": "8a836452-7655-49c8-9aaf-c2441440165f"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:44:50.443279 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-c0213590-1c69-4a2d-92e9-3c91264b2e70 req-c99fb798-5319-4f19-b0c4-55e4449af0af service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:50.444478 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-c0213590-1c69-4a2d-92e9-3c91264b2e70 req-c99fb798-5319-4f19-b0c4-55e4449af0af service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:50.476562 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-c0213590-1c69-4a2d-92e9-3c91264b2e70 req-c99fb798-5319-4f19-b0c4-55e4449af0af service nova] Creating event network-changed:8a836452-7655-49c8-9aaf-c2441440165f for instance 5a30608a-b03b-41fb-95be-6ba3eba17562 on hv-cinder-85083 Jul 25 05:44:50.488357 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-c0213590-1c69-4a2d-92e9-3c91264b2e70 req-c99fb798-5319-4f19-b0c4-55e4449af0af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099363 Jul 25 05:44:50.489635 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 414/814] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:44:50.574654 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-8f5b44a5-46ad-4a5c-b683-3cd5d621b549 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lazy-loading 'services' on Instance uuid 5a30608a-b03b-41fb-95be-6ba3eba17562 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:44:50.756606 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8f5b44a5-46ad-4a5c-b683-3cd5d621b549 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments/fd34110a-3bc3-4cdf-b5d7-cc87757f7e86" status: 202 len: 0 microversion: 2.1 time: 0.383350 Jul 25 05:44:50.757977 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 401/815] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:44:50 2022] DELETE /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments/fd34110a-3bc3-4cdf-b5d7-cc87757f7e86 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:44:50.769027 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-306ae38b-3f88-4a2b-b5f5-2fb929efc7fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:50.770724 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-306ae38b-3f88-4a2b-b5f5-2fb929efc7fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:50.779874 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-306ae38b-3f88-4a2b-b5f5-2fb929efc7fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:50.781242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-306ae38b-3f88-4a2b-b5f5-2fb929efc7fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:50.816473 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-306ae38b-3f88-4a2b-b5f5-2fb929efc7fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:50.817354 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-306ae38b-3f88-4a2b-b5f5-2fb929efc7fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:50.923638 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-306ae38b-3f88-4a2b-b5f5-2fb929efc7fa tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159586 Jul 25 05:44:50.924325 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 415/816] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:50 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:51.361445 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-113bdc50-bb0a-4da2-9bae-5903b077abb6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:51.362367 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-113bdc50-bb0a-4da2-9bae-5903b077abb6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:51.371400 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-113bdc50-bb0a-4da2-9bae-5903b077abb6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:51.372255 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-113bdc50-bb0a-4da2-9bae-5903b077abb6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:51.373485 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-113bdc50-bb0a-4da2-9bae-5903b077abb6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:51.374206 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-113bdc50-bb0a-4da2-9bae-5903b077abb6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:51.617134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-113bdc50-bb0a-4da2-9bae-5903b077abb6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:51.635744 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-113bdc50-bb0a-4da2-9bae-5903b077abb6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:51.638972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-113bdc50-bb0a-4da2-9bae-5903b077abb6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:51.642002 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-113bdc50-bb0a-4da2-9bae-5903b077abb6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.285176 Jul 25 05:44:51.643140 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 402/817] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:51 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:44:51.936570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e835fc1e-e949-4d95-a346-ac6fbf763f23 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:51.937734 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e835fc1e-e949-4d95-a346-ac6fbf763f23 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:51.944686 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e835fc1e-e949-4d95-a346-ac6fbf763f23 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:51.945409 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e835fc1e-e949-4d95-a346-ac6fbf763f23 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:51.958704 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e835fc1e-e949-4d95-a346-ac6fbf763f23 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:51.959346 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e835fc1e-e949-4d95-a346-ac6fbf763f23 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:52.023536 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e835fc1e-e949-4d95-a346-ac6fbf763f23 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091211 Jul 25 05:44:52.029043 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 416/818] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:51 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:52.663399 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-68a135e8-6297-4baf-814f-7cf2e1ceafd0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:52.664111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-68a135e8-6297-4baf-814f-7cf2e1ceafd0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:52.670958 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-68a135e8-6297-4baf-814f-7cf2e1ceafd0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:52.671720 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-68a135e8-6297-4baf-814f-7cf2e1ceafd0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:52.673168 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-68a135e8-6297-4baf-814f-7cf2e1ceafd0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:52.673885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-68a135e8-6297-4baf-814f-7cf2e1ceafd0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:52.846479 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-68a135e8-6297-4baf-814f-7cf2e1ceafd0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:52.865253 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-68a135e8-6297-4baf-814f-7cf2e1ceafd0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:52.867067 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-68a135e8-6297-4baf-814f-7cf2e1ceafd0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:52.869057 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-68a135e8-6297-4baf-814f-7cf2e1ceafd0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.210504 Jul 25 05:44:52.869643 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 403/819] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:52 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:53.035932 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c6f90980-2d15-457f-93d0-4ab7cba60fc2 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:53.036769 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c6f90980-2d15-457f-93d0-4ab7cba60fc2 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:53.044056 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c6f90980-2d15-457f-93d0-4ab7cba60fc2 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:53.044515 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c6f90980-2d15-457f-93d0-4ab7cba60fc2 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:53.045310 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c6f90980-2d15-457f-93d0-4ab7cba60fc2 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:53.045968 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c6f90980-2d15-457f-93d0-4ab7cba60fc2 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:53.078215 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c6f90980-2d15-457f-93d0-4ab7cba60fc2 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046209 Jul 25 05:44:53.078791 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 417/820] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:53 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:53.886971 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ec604af1-e138-4a65-aa87-1b8f7023d793 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:53.887642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ec604af1-e138-4a65-aa87-1b8f7023d793 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:53.906957 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec604af1-e138-4a65-aa87-1b8f7023d793 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:53.907418 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec604af1-e138-4a65-aa87-1b8f7023d793 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:53.910904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec604af1-e138-4a65-aa87-1b8f7023d793 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:53.911680 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec604af1-e138-4a65-aa87-1b8f7023d793 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:54.090525 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-264d8016-079d-42cd-a91d-c5fdb206c97e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:54.092546 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-264d8016-079d-42cd-a91d-c5fdb206c97e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:54.099344 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-264d8016-079d-42cd-a91d-c5fdb206c97e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:54.108849 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ec604af1-e138-4a65-aa87-1b8f7023d793 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:54.109006 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-264d8016-079d-42cd-a91d-c5fdb206c97e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:54.109948 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-264d8016-079d-42cd-a91d-c5fdb206c97e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:54.110467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-264d8016-079d-42cd-a91d-c5fdb206c97e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:54.123320 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ec604af1-e138-4a65-aa87-1b8f7023d793 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:54.125635 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ec604af1-e138-4a65-aa87-1b8f7023d793 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:54.127096 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ec604af1-e138-4a65-aa87-1b8f7023d793 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.244445 Jul 25 05:44:54.127870 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 404/821] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:53 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:54.159973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-264d8016-079d-42cd-a91d-c5fdb206c97e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073665 Jul 25 05:44:54.164408 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 418/822] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:54 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:44:55.145712 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5555c640-f17c-40ea-be18-8085b04a547a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:55.146411 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5555c640-f17c-40ea-be18-8085b04a547a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:55.153871 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5555c640-f17c-40ea-be18-8085b04a547a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:55.154373 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5555c640-f17c-40ea-be18-8085b04a547a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:55.155201 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5555c640-f17c-40ea-be18-8085b04a547a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:55.155700 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5555c640-f17c-40ea-be18-8085b04a547a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:55.176196 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8306fd3e-ba1c-4ce2-88d9-5582d23e7483 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:55.177350 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8306fd3e-ba1c-4ce2-88d9-5582d23e7483 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:55.185351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8306fd3e-ba1c-4ce2-88d9-5582d23e7483 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:55.186640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8306fd3e-ba1c-4ce2-88d9-5582d23e7483 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:55.188248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8306fd3e-ba1c-4ce2-88d9-5582d23e7483 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:55.188697 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8306fd3e-ba1c-4ce2-88d9-5582d23e7483 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:55.231629 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8306fd3e-ba1c-4ce2-88d9-5582d23e7483 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060306 Jul 25 05:44:55.232210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 419/823] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:55 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:55.307945 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5555c640-f17c-40ea-be18-8085b04a547a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:55.322102 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5555c640-f17c-40ea-be18-8085b04a547a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:55.323482 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5555c640-f17c-40ea-be18-8085b04a547a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:55.324702 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5555c640-f17c-40ea-be18-8085b04a547a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.182997 Jul 25 05:44:55.325294 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 405/824] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:55 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:56.243957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-bc66682b-a66d-4bae-8ecd-94e864362f1f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:56.245970 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-bc66682b-a66d-4bae-8ecd-94e864362f1f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:56.255176 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bc66682b-a66d-4bae-8ecd-94e864362f1f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:56.256024 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bc66682b-a66d-4bae-8ecd-94e864362f1f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:56.257523 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bc66682b-a66d-4bae-8ecd-94e864362f1f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:56.258337 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bc66682b-a66d-4bae-8ecd-94e864362f1f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:56.305302 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-bc66682b-a66d-4bae-8ecd-94e864362f1f tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065900 Jul 25 05:44:56.306732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 420/825] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:56 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:56.345068 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1b217499-63fe-43cd-9b93-ad839cc5f2bb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:56.346567 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1b217499-63fe-43cd-9b93-ad839cc5f2bb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:56.358218 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1b217499-63fe-43cd-9b93-ad839cc5f2bb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:56.358963 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1b217499-63fe-43cd-9b93-ad839cc5f2bb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:56.360101 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1b217499-63fe-43cd-9b93-ad839cc5f2bb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:56.361180 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1b217499-63fe-43cd-9b93-ad839cc5f2bb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:56.671731 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1b217499-63fe-43cd-9b93-ad839cc5f2bb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:56.681279 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1b217499-63fe-43cd-9b93-ad839cc5f2bb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:56.683118 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1b217499-63fe-43cd-9b93-ad839cc5f2bb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:56.685837 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1b217499-63fe-43cd-9b93-ad839cc5f2bb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.345960 Jul 25 05:44:56.689126 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 406/826] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:56 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:57.318366 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2f32a00a-1f5b-4112-9ce3-95bac72151ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:57.319338 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2f32a00a-1f5b-4112-9ce3-95bac72151ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:57.326800 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2f32a00a-1f5b-4112-9ce3-95bac72151ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:57.327263 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2f32a00a-1f5b-4112-9ce3-95bac72151ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:57.328169 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2f32a00a-1f5b-4112-9ce3-95bac72151ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:57.328621 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2f32a00a-1f5b-4112-9ce3-95bac72151ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:57.364860 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2f32a00a-1f5b-4112-9ce3-95bac72151ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051394 Jul 25 05:44:57.366426 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 421/827] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:57 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:57.705462 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cc22b46a-a70e-406a-a508-e81b1f7d0212 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:57.706303 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cc22b46a-a70e-406a-a508-e81b1f7d0212 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:57.714153 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc22b46a-a70e-406a-a508-e81b1f7d0212 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:57.714777 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc22b46a-a70e-406a-a508-e81b1f7d0212 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:57.715666 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc22b46a-a70e-406a-a508-e81b1f7d0212 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:57.716229 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc22b46a-a70e-406a-a508-e81b1f7d0212 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:57.896657 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cc22b46a-a70e-406a-a508-e81b1f7d0212 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:57.908398 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cc22b46a-a70e-406a-a508-e81b1f7d0212 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:57.910175 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cc22b46a-a70e-406a-a508-e81b1f7d0212 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:57.911666 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cc22b46a-a70e-406a-a508-e81b1f7d0212 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.210493 Jul 25 05:44:57.912233 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 407/828] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:57 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:58.378127 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-c234f4e4-52ae-40c1-924f-d6c9262af88e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:58.379035 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-c234f4e4-52ae-40c1-924f-d6c9262af88e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:58.385596 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c234f4e4-52ae-40c1-924f-d6c9262af88e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:58.386045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c234f4e4-52ae-40c1-924f-d6c9262af88e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:58.386801 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c234f4e4-52ae-40c1-924f-d6c9262af88e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:58.387264 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-c234f4e4-52ae-40c1-924f-d6c9262af88e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:58.416209 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-c234f4e4-52ae-40c1-924f-d6c9262af88e tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041546 Jul 25 05:44:58.416763 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 422/829] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:58 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:44:58.929754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fe6b9333-5a94-4431-8687-e62ed23b4f7f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:58.930365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fe6b9333-5a94-4431-8687-e62ed23b4f7f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:58.939482 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe6b9333-5a94-4431-8687-e62ed23b4f7f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:58.939942 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe6b9333-5a94-4431-8687-e62ed23b4f7f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:58.940725 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe6b9333-5a94-4431-8687-e62ed23b4f7f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:58.941565 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe6b9333-5a94-4431-8687-e62ed23b4f7f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:59.102582 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fe6b9333-5a94-4431-8687-e62ed23b4f7f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:59.113394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fe6b9333-5a94-4431-8687-e62ed23b4f7f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:59.115160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fe6b9333-5a94-4431-8687-e62ed23b4f7f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:44:59.116634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fe6b9333-5a94-4431-8687-e62ed23b4f7f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.190693 Jul 25 05:44:59.128177 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 408/830] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:44:58 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:44:59.427461 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-77e47839-1041-4d33-9bb4-7821cdd4914d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:59.428387 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-77e47839-1041-4d33-9bb4-7821cdd4914d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:59.436285 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-77e47839-1041-4d33-9bb4-7821cdd4914d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:59.436748 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-77e47839-1041-4d33-9bb4-7821cdd4914d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:59.437545 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-77e47839-1041-4d33-9bb4-7821cdd4914d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:59.437992 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-77e47839-1041-4d33-9bb4-7821cdd4914d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:59.469271 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-77e47839-1041-4d33-9bb4-7821cdd4914d tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045549 Jul 25 05:44:59.474839 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 423/831] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 25 05:44:59 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 05:44:59.481575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0f52518a-7ead-4c27-812d-2a63da00678c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:44:59.482280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0f52518a-7ead-4c27-812d-2a63da00678c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:44:59.489480 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0f52518a-7ead-4c27-812d-2a63da00678c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:59.490067 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0f52518a-7ead-4c27-812d-2a63da00678c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:59.490981 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0f52518a-7ead-4c27-812d-2a63da00678c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:44:59.491581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0f52518a-7ead-4c27-812d-2a63da00678c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:44:59.634150 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-0f52518a-7ead-4c27-812d-2a63da00678c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] HTTP exception thrown: Instance 5a30608a-b03b-41fb-95be-6ba3eba17562 is not attached to volume fd34110a-3bc3-4cdf-b5d7-cc87757f7e86 Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0f52518a-7ead-4c27-812d-2a63da00678c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Request method failure captured: Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments/fd34110a-3bc3-4cdf-b5d7-cc87757f7e86 HTTP/1.1 Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3i06QfB7_-1pUt_2TPB1L5tNcZN_8msVfL6y8avRLCwV7W1wsv4Xsk5x5VDr0VKZksT6tF0GXCfDmtNbwyJ4w0t4EQW09WDf_tL_537eQRGAGMT1stZhdU73dNCPbiXq179o0RHilDKBc6s-brfyBVd0cuuQhOPtsMKky1nuks6lERk Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 987ce20ceedd49cb9419cc506c50fce3 Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-TestMinimumBasicScenario-1614210365 Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:44:59.638623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:44:59.640424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/987ce20ceedd49cb9419cc506c50fce3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/987ce20ceedd49cb9419cc506c50fce3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/987ce20ceedd49cb9419cc506c50fce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_987ce20ceedd49cb9419cc506c50fce3"}]}] Jul 25 05:44:59.640424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-TestMinimumBasicScenario-1614210365 Jul 25 05:44:59.640424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 987ce20ceedd49cb9419cc506c50fce3 Jul 25 05:44:59.640424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1614210365 Jul 25 05:44:59.640424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-TestMinimumBasicScenario-1614210365-project Jul 25 05:44:59.640424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:44:59.640424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:44:59.640424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 598f7eff11f545a88d339812207f0f19 Jul 25 05:44:59.640424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-TestMinimumBasicScenario-1614210365-project Jul 25 05:44:59.640424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:44:59.640424 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 5a30608a-b03b-41fb-95be-6ba3eba17562 is not attached to volume fd34110a-3bc3-4cdf-b5d7-cc87757f7e86 Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'server_id': '5a30608a-b03b-41fb-95be-6ba3eba17562', 'id': 'fd34110a-3bc3-4cdf-b5d7-cc87757f7e86'} Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fd34110a-3bc3-4cdf-b5d7-cc87757f7e86. Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:44:59.644714 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a30608a-b03b-41fb-95be-6ba3eba17562 is not attached to volume fd34110a-3bc3-4cdf-b5d7-cc87757f7e86 Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a30608a-b03b-41fb-95be-6ba3eba17562 is not attached to volume fd34110a-3bc3-4cdf-b5d7-cc87757f7e86 Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:44:59.646429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0f52518a-7ead-4c27-812d-2a63da00678c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Returning 404 to user: Instance 5a30608a-b03b-41fb-95be-6ba3eba17562 is not attached to volume fd34110a-3bc3-4cdf-b5d7-cc87757f7e86 {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:44:59.647636 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0f52518a-7ead-4c27-812d-2a63da00678c tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments/fd34110a-3bc3-4cdf-b5d7-cc87757f7e86" status: 404 len: 154 microversion: 2.1 time: 0.164269 Jul 25 05:44:59.647636 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 409/832] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 25 05:44:59 2022] DELETE /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562/os-volume_attachments/fd34110a-3bc3-4cdf-b5d7-cc87757f7e86 => generated 154 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:45:00.135323 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ca713a12-ec58-4c21-a1d0-82312475637d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:00.136016 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ca713a12-ec58-4c21-a1d0-82312475637d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:00.142150 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ca713a12-ec58-4c21-a1d0-82312475637d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:00.142619 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ca713a12-ec58-4c21-a1d0-82312475637d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:00.143367 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ca713a12-ec58-4c21-a1d0-82312475637d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:00.143812 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ca713a12-ec58-4c21-a1d0-82312475637d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:00.279736 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ca713a12-ec58-4c21-a1d0-82312475637d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:00.288106 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ca713a12-ec58-4c21-a1d0-82312475637d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:00.289657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ca713a12-ec58-4c21-a1d0-82312475637d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:00.291037 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ca713a12-ec58-4c21-a1d0-82312475637d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.159651 Jul 25 05:45:00.291595 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 424/833] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:00 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:00.813498 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2541ec71-d77a-434d-bcd9-945a758d77b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:00.813994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2541ec71-d77a-434d-bcd9-945a758d77b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:00.820504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2541ec71-d77a-434d-bcd9-945a758d77b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:00.821046 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2541ec71-d77a-434d-bcd9-945a758d77b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:00.822387 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2541ec71-d77a-434d-bcd9-945a758d77b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:00.822836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2541ec71-d77a-434d-bcd9-945a758d77b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:00.847158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2541ec71-d77a-434d-bcd9-945a758d77b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:45:00.926363 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2541ec71-d77a-434d-bcd9-945a758d77b3 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 204 len: 0 microversion: 2.1 time: 0.116262 Jul 25 05:45:00.927391 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 410/834] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:45:00 2022] DELETE /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:45:00.937611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-df79936e-e7d6-4ccb-bd01-8625f63f4dbe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:00.938239 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-df79936e-e7d6-4ccb-bd01-8625f63f4dbe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:00.945297 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-df79936e-e7d6-4ccb-bd01-8625f63f4dbe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:00.945767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-df79936e-e7d6-4ccb-bd01-8625f63f4dbe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:00.947204 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-df79936e-e7d6-4ccb-bd01-8625f63f4dbe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:00.947763 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-df79936e-e7d6-4ccb-bd01-8625f63f4dbe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:01.088132 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-df79936e-e7d6-4ccb-bd01-8625f63f4dbe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:01.095814 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-df79936e-e7d6-4ccb-bd01-8625f63f4dbe tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1553 microversion: 2.1 time: 0.163396 Jul 25 05:45:01.096372 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 425/835] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:00 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:01.309352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3a95c7fa-f0c4-4ad8-88e2-9a37cc64ca7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:01.310057 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3a95c7fa-f0c4-4ad8-88e2-9a37cc64ca7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:01.316095 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a95c7fa-f0c4-4ad8-88e2-9a37cc64ca7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:01.316561 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a95c7fa-f0c4-4ad8-88e2-9a37cc64ca7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:01.317376 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a95c7fa-f0c4-4ad8-88e2-9a37cc64ca7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:01.317826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a95c7fa-f0c4-4ad8-88e2-9a37cc64ca7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:01.338880 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:01.461399 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3a95c7fa-f0c4-4ad8-88e2-9a37cc64ca7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:01.471237 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3a95c7fa-f0c4-4ad8-88e2-9a37cc64ca7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:01.472750 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3a95c7fa-f0c4-4ad8-88e2-9a37cc64ca7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:01.473932 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3a95c7fa-f0c4-4ad8-88e2-9a37cc64ca7a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.168907 Jul 25 05:45:01.474489 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 411/836] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:01 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:02.114808 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-45e93f71-f61f-4502-89fc-14ba0d3acaeb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:02.115752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-45e93f71-f61f-4502-89fc-14ba0d3acaeb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:02.122868 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-45e93f71-f61f-4502-89fc-14ba0d3acaeb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:02.123328 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-45e93f71-f61f-4502-89fc-14ba0d3acaeb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:02.124126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-45e93f71-f61f-4502-89fc-14ba0d3acaeb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:02.124573 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-45e93f71-f61f-4502-89fc-14ba0d3acaeb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:02.254227 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-45e93f71-f61f-4502-89fc-14ba0d3acaeb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:02.262370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-45e93f71-f61f-4502-89fc-14ba0d3acaeb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1553 microversion: 2.1 time: 0.151320 Jul 25 05:45:02.262946 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 426/837] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:02 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:02.494972 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-52b47c4d-027f-443f-9148-46016e5034bc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:02.497886 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-52b47c4d-027f-443f-9148-46016e5034bc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:02.505709 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52b47c4d-027f-443f-9148-46016e5034bc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:02.506158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52b47c4d-027f-443f-9148-46016e5034bc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:02.507120 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52b47c4d-027f-443f-9148-46016e5034bc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:02.507737 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-52b47c4d-027f-443f-9148-46016e5034bc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:02.660469 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-52b47c4d-027f-443f-9148-46016e5034bc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:02.671401 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-52b47c4d-027f-443f-9148-46016e5034bc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:02.673439 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-52b47c4d-027f-443f-9148-46016e5034bc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:02.674863 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-52b47c4d-027f-443f-9148-46016e5034bc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.185218 Jul 25 05:45:02.675647 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 412/838] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:02 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:03.282007 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3ae7f19b-cf8b-4a08-a394-3762bf5a0beb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:03.283911 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3ae7f19b-cf8b-4a08-a394-3762bf5a0beb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:03.291455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3ae7f19b-cf8b-4a08-a394-3762bf5a0beb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:03.291950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3ae7f19b-cf8b-4a08-a394-3762bf5a0beb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:03.292896 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3ae7f19b-cf8b-4a08-a394-3762bf5a0beb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:03.293521 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3ae7f19b-cf8b-4a08-a394-3762bf5a0beb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:03.433600 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3ae7f19b-cf8b-4a08-a394-3762bf5a0beb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:03.441071 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3ae7f19b-cf8b-4a08-a394-3762bf5a0beb tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1553 microversion: 2.1 time: 0.165182 Jul 25 05:45:03.441629 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 427/839] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:03 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:03.693478 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f78da621-4aad-4076-b873-16ba349545dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:03.694205 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f78da621-4aad-4076-b873-16ba349545dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:03.701701 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f78da621-4aad-4076-b873-16ba349545dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:03.702162 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f78da621-4aad-4076-b873-16ba349545dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:03.702938 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f78da621-4aad-4076-b873-16ba349545dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:03.703384 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f78da621-4aad-4076-b873-16ba349545dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:03.836829 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f78da621-4aad-4076-b873-16ba349545dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:03.846103 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f78da621-4aad-4076-b873-16ba349545dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:03.847626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f78da621-4aad-4076-b873-16ba349545dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:03.848799 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f78da621-4aad-4076-b873-16ba349545dd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.159751 Jul 25 05:45:03.849372 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 413/840] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:03 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:04.458106 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1d6219b7-8e36-493a-b1c9-dc509a72795b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:04.458744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1d6219b7-8e36-493a-b1c9-dc509a72795b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:04.465313 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1d6219b7-8e36-493a-b1c9-dc509a72795b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:04.465767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1d6219b7-8e36-493a-b1c9-dc509a72795b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:04.466531 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1d6219b7-8e36-493a-b1c9-dc509a72795b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:04.466972 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1d6219b7-8e36-493a-b1c9-dc509a72795b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:04.471882 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=100 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:04.601981 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1d6219b7-8e36-493a-b1c9-dc509a72795b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:04.609948 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1d6219b7-8e36-493a-b1c9-dc509a72795b tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1553 microversion: 2.1 time: 0.155639 Jul 25 05:45:04.610519 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 428/841] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:04 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:04.867122 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-dd1fd2c5-2813-44f4-ac13-c862ac6c72a9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:04.867741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-dd1fd2c5-2813-44f4-ac13-c862ac6c72a9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:04.875375 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dd1fd2c5-2813-44f4-ac13-c862ac6c72a9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:04.875836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dd1fd2c5-2813-44f4-ac13-c862ac6c72a9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:04.876602 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dd1fd2c5-2813-44f4-ac13-c862ac6c72a9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:04.877115 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dd1fd2c5-2813-44f4-ac13-c862ac6c72a9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:05.013274 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-dd1fd2c5-2813-44f4-ac13-c862ac6c72a9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:05.022667 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-dd1fd2c5-2813-44f4-ac13-c862ac6c72a9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:05.024190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-dd1fd2c5-2813-44f4-ac13-c862ac6c72a9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:05.026316 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-dd1fd2c5-2813-44f4-ac13-c862ac6c72a9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.163171 Jul 25 05:45:05.026931 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 414/842] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:04 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:05.627385 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-14ad1ef5-b364-422a-86b3-423ce13f11ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:05.627999 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-14ad1ef5-b364-422a-86b3-423ce13f11ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:05.635328 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14ad1ef5-b364-422a-86b3-423ce13f11ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:05.635775 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14ad1ef5-b364-422a-86b3-423ce13f11ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:05.636550 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14ad1ef5-b364-422a-86b3-423ce13f11ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:05.637020 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-14ad1ef5-b364-422a-86b3-423ce13f11ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:05.776634 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-14ad1ef5-b364-422a-86b3-423ce13f11ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:05.786134 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-14ad1ef5-b364-422a-86b3-423ce13f11ba tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1553 microversion: 2.1 time: 0.162529 Jul 25 05:45:05.786964 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 429/843] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:05 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:06.046693 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d6169c19-b5f3-4397-a1b5-737771287344 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:06.047301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d6169c19-b5f3-4397-a1b5-737771287344 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:06.053731 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d6169c19-b5f3-4397-a1b5-737771287344 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:06.054188 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d6169c19-b5f3-4397-a1b5-737771287344 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:06.054949 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d6169c19-b5f3-4397-a1b5-737771287344 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:06.055436 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d6169c19-b5f3-4397-a1b5-737771287344 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:06.276041 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d6169c19-b5f3-4397-a1b5-737771287344 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:06.293736 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d6169c19-b5f3-4397-a1b5-737771287344 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:06.295584 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d6169c19-b5f3-4397-a1b5-737771287344 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:06.298564 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d6169c19-b5f3-4397-a1b5-737771287344 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.255472 Jul 25 05:45:06.299128 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 415/844] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:06 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:06.743396 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-4ae5d700-2ce7-4d3b-aba6-5637affbacce req-8f6f8299-e5b7-4a69-83d1-ffd956cbe42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a30608a-b03b-41fb-95be-6ba3eba17562", "name": "network-vif-deleted", "tag": "8a836452-7655-49c8-9aaf-c2441440165f"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:45:06.755087 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-4ae5d700-2ce7-4d3b-aba6-5637affbacce req-8f6f8299-e5b7-4a69-83d1-ffd956cbe42a service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:06.755567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-4ae5d700-2ce7-4d3b-aba6-5637affbacce req-8f6f8299-e5b7-4a69-83d1-ffd956cbe42a service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:06.770025 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-4ae5d700-2ce7-4d3b-aba6-5637affbacce req-8f6f8299-e5b7-4a69-83d1-ffd956cbe42a service nova] Creating event network-vif-deleted:8a836452-7655-49c8-9aaf-c2441440165f for instance 5a30608a-b03b-41fb-95be-6ba3eba17562 on hv-cinder-85083 Jul 25 05:45:06.777501 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-4ae5d700-2ce7-4d3b-aba6-5637affbacce req-8f6f8299-e5b7-4a69-83d1-ffd956cbe42a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038301 Jul 25 05:45:06.778428 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 430/845] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:45:06.807290 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5695ce78-3a9b-4ac7-8d87-571935cf77a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:06.807917 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5695ce78-3a9b-4ac7-8d87-571935cf77a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:06.814234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5695ce78-3a9b-4ac7-8d87-571935cf77a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:06.814696 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5695ce78-3a9b-4ac7-8d87-571935cf77a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:06.815475 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5695ce78-3a9b-4ac7-8d87-571935cf77a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:06.815924 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5695ce78-3a9b-4ac7-8d87-571935cf77a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:06.889580 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5695ce78-3a9b-4ac7-8d87-571935cf77a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598f7eff11f545a88d339812207f0f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987ce20ceedd49cb9419cc506c50fce3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:06.897542 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5695ce78-3a9b-4ac7-8d87-571935cf77a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 200 len: 1342 microversion: 2.1 time: 0.097519 Jul 25 05:45:06.898119 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 416/846] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:06 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 1342 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:07.317758 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-891b0a87-4fa7-4495-942f-20ace9ea45cb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:07.318455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-891b0a87-4fa7-4495-942f-20ace9ea45cb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:07.320395 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=52 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:07.326835 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-891b0a87-4fa7-4495-942f-20ace9ea45cb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:07.327305 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-891b0a87-4fa7-4495-942f-20ace9ea45cb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:07.328131 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-891b0a87-4fa7-4495-942f-20ace9ea45cb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:07.328515 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-891b0a87-4fa7-4495-942f-20ace9ea45cb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:07.470212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-891b0a87-4fa7-4495-942f-20ace9ea45cb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:07.479921 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-891b0a87-4fa7-4495-942f-20ace9ea45cb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:07.481427 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-891b0a87-4fa7-4495-942f-20ace9ea45cb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:07.482592 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-891b0a87-4fa7-4495-942f-20ace9ea45cb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.169266 Jul 25 05:45:07.483150 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 431/847] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:07 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:07.915111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-90ef57df-911b-46fc-a52c-49b1b51e43a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:07.916332 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-90ef57df-911b-46fc-a52c-49b1b51e43a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] [instance: 5a30608a-b03b-41fb-95be-6ba3eba17562] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:07.922488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-90ef57df-911b-46fc-a52c-49b1b51e43a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:07.923008 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-90ef57df-911b-46fc-a52c-49b1b51e43a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:07.923881 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-90ef57df-911b-46fc-a52c-49b1b51e43a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:07.924317 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-90ef57df-911b-46fc-a52c-49b1b51e43a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:07.937818 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-90ef57df-911b-46fc-a52c-49b1b51e43a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] HTTP exception thrown: Instance 5a30608a-b03b-41fb-95be-6ba3eba17562 could not be found. Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-90ef57df-911b-46fc-a52c-49b1b51e43a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Request method failure captured: Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 HTTP/1.1 Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3i06QfB7_-1pUt_2TPB1L5tNcZN_8msVfL6y8avRLCwV7W1wsv4Xsk5x5VDr0VKZksT6tF0GXCfDmtNbwyJ4w0t4EQW09WDf_tL_537eQRGAGMT1stZhdU73dNCPbiXq179o0RHilDKBc6s-brfyBVd0cuuQhOPtsMKky1nuks6lERk Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 987ce20ceedd49cb9419cc506c50fce3 Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-TestMinimumBasicScenario-1614210365 Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:45:07.939449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/987ce20ceedd49cb9419cc506c50fce3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/987ce20ceedd49cb9419cc506c50fce3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/987ce20ceedd49cb9419cc506c50fce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_987ce20ceedd49cb9419cc506c50fce3"}]}] Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-TestMinimumBasicScenario-1614210365 Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 987ce20ceedd49cb9419cc506c50fce3 Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1614210365 Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-TestMinimumBasicScenario-1614210365-project Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 598f7eff11f545a88d339812207f0f19 Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-TestMinimumBasicScenario-1614210365-project Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 5a30608a-b03b-41fb-95be-6ba3eba17562 could not be found. Jul 25 05:45:07.941134 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '5a30608a-b03b-41fb-95be-6ba3eba17562'} Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a30608a-b03b-41fb-95be-6ba3eba17562 could not be found. Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:45:07.942084 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a30608a-b03b-41fb-95be-6ba3eba17562 could not be found. Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a30608a-b03b-41fb-95be-6ba3eba17562 could not be found. Jul 25 05:45:07.943843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:45:07.945665 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-90ef57df-911b-46fc-a52c-49b1b51e43a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Returning 404 to user: Instance 5a30608a-b03b-41fb-95be-6ba3eba17562 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:45:07.945665 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-90ef57df-911b-46fc-a52c-49b1b51e43a0 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562" status: 404 len: 111 microversion: 2.1 time: 0.029532 Jul 25 05:45:07.945665 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 417/848] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:07 2022] GET /compute/v2.1/servers/5a30608a-b03b-41fb-95be-6ba3eba17562 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:45:07.952683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-889a0686-2c45-451f-9860-030aefea7451 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] Calling method '.version_select at 0x7fcc84104700>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:07.971739 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-889a0686-2c45-451f-9860-030aefea7451 tempest-TestMinimumBasicScenario-1614210365 tempest-TestMinimumBasicScenario-1614210365-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-854781868" status: 202 len: 0 microversion: 2.1 time: 0.022438 Jul 25 05:45:07.972232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 432/849] 10.222.0.33 () {58 vars in 1268 bytes} [Mon Jul 25 05:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-854781868 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:45:08.501596 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cbe4a48a-a2be-4cf9-a3b2-6f3ee154c3b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:08.502216 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cbe4a48a-a2be-4cf9-a3b2-6f3ee154c3b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:08.504191 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:08.511485 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbe4a48a-a2be-4cf9-a3b2-6f3ee154c3b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:08.512203 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbe4a48a-a2be-4cf9-a3b2-6f3ee154c3b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:08.512868 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbe4a48a-a2be-4cf9-a3b2-6f3ee154c3b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:08.513366 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbe4a48a-a2be-4cf9-a3b2-6f3ee154c3b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:08.692999 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cbe4a48a-a2be-4cf9-a3b2-6f3ee154c3b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:08.706407 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cbe4a48a-a2be-4cf9-a3b2-6f3ee154c3b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:08.707843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cbe4a48a-a2be-4cf9-a3b2-6f3ee154c3b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:08.711555 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cbe4a48a-a2be-4cf9-a3b2-6f3ee154c3b9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.212635 Jul 25 05:45:08.711555 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 418/850] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:08 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:09.736433 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-27bf156f-975d-47c0-b75f-0d8cbce88dcd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:09.737848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-27bf156f-975d-47c0-b75f-0d8cbce88dcd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:09.748807 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-27bf156f-975d-47c0-b75f-0d8cbce88dcd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:09.749880 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-27bf156f-975d-47c0-b75f-0d8cbce88dcd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:09.752686 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-27bf156f-975d-47c0-b75f-0d8cbce88dcd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:09.753302 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-27bf156f-975d-47c0-b75f-0d8cbce88dcd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:09.912145 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1876596765", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1985723475", "security_groups": [{"name": "tempest-secgroup-smoke-1677006254"}], "block_device_mapping_v2": [{"uuid": "7b14af58-a240-4312-b3a8-dc225500fa3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0bd65f0e-472c-4905-913d-3224424e7dac"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:45:10.035417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-27bf156f-975d-47c0-b75f-0d8cbce88dcd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:10.050178 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-27bf156f-975d-47c0-b75f-0d8cbce88dcd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:10.052829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-27bf156f-975d-47c0-b75f-0d8cbce88dcd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:10.054399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-27bf156f-975d-47c0-b75f-0d8cbce88dcd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.329917 Jul 25 05:45:10.055165 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 433/851] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:09 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:10.068378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] validate_networks() for [('0bd65f0e-472c-4905-913d-3224424e7dac', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:45:10.617570 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:45:10.617994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:45:10.618605 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:45:10.619024 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:45:10.619451 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:45:10.630209 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:10.630924 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:10.632562 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:10.633207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:10.659011 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Getting quotas for project ee638472255a48d2bdffa17a4ff22339. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:45:10.667686 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Getting quotas for user 1f815f111bf74739969736acea131927 and project ee638472255a48d2bdffa17a4ff22339. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:45:10.789868 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:45:10.792968 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b14af58-a240-4312-b3a8-dc225500fa3b',volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:45:11.081639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8bf41961-a4b4-4b01-a511-fc3b442536ba tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:11.083160 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8bf41961-a4b4-4b01-a511-fc3b442536ba tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:11.094683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8bf41961-a4b4-4b01-a511-fc3b442536ba tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:11.098725 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8bf41961-a4b4-4b01-a511-fc3b442536ba tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:11.108340 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8bf41961-a4b4-4b01-a511-fc3b442536ba tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:11.108975 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8bf41961-a4b4-4b01-a511-fc3b442536ba tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:11.163022 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2a8e4987-f580-4a82-9cad-d9a4b4cae24b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.255089 Jul 25 05:45:11.183099 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 419/852] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:45:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 05:45:11.204757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-46c3e681-3563-4062-b3fe-a3b7913cd6f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:11.206100 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-46c3e681-3563-4062-b3fe-a3b7913cd6f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:11.381086 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-46c3e681-3563-4062-b3fe-a3b7913cd6f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:11.389285 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-46c3e681-3563-4062-b3fe-a3b7913cd6f0 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1095 microversion: 2.1 time: 0.192184 Jul 25 05:45:11.392571 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 420/853] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:11 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1095 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:11.459517 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8bf41961-a4b4-4b01-a511-fc3b442536ba tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:11.472982 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8bf41961-a4b4-4b01-a511-fc3b442536ba tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:11.477638 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8bf41961-a4b4-4b01-a511-fc3b442536ba tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:11.480446 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8bf41961-a4b4-4b01-a511-fc3b442536ba tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.407288 Jul 25 05:45:11.481587 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 434/854] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:11 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:45:11.496698 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-dea5d6aa-c662-4870-91c2-b64f4fed5438 req-520eb61b-00ac-4876-b0d9-70b4f373ea57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb16475-6c9b-4c00-be15-0b5f68b01d0a", "name": "network-vif-plugged", "status": "completed", "tag": "15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:45:11.507979 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-dea5d6aa-c662-4870-91c2-b64f4fed5438 req-520eb61b-00ac-4876-b0d9-70b4f373ea57 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:11.508740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-dea5d6aa-c662-4870-91c2-b64f4fed5438 req-520eb61b-00ac-4876-b0d9-70b4f373ea57 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:11.522280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-dea5d6aa-c662-4870-91c2-b64f4fed5438 req-520eb61b-00ac-4876-b0d9-70b4f373ea57 service nova] Creating event network-vif-plugged:15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc for instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a on hv-cinder-85083 Jul 25 05:45:11.529324 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-dea5d6aa-c662-4870-91c2-b64f4fed5438 req-520eb61b-00ac-4876-b0d9-70b4f373ea57 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046104 Jul 25 05:45:11.530671 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 421/855] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:45:12.414355 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-49396760-8ada-44ce-a905-037a84eb30a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:12.415182 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-49396760-8ada-44ce-a905-037a84eb30a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:12.426041 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49396760-8ada-44ce-a905-037a84eb30a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:12.429824 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49396760-8ada-44ce-a905-037a84eb30a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:12.430739 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49396760-8ada-44ce-a905-037a84eb30a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:12.431793 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49396760-8ada-44ce-a905-037a84eb30a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:12.500578 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6cb24582-393e-4382-b823-7598d7747d78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:12.501337 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6cb24582-393e-4382-b823-7598d7747d78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:12.527013 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6cb24582-393e-4382-b823-7598d7747d78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:12.527684 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6cb24582-393e-4382-b823-7598d7747d78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:12.528731 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6cb24582-393e-4382-b823-7598d7747d78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:12.529288 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6cb24582-393e-4382-b823-7598d7747d78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:12.644460 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-49396760-8ada-44ce-a905-037a84eb30a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:12.666181 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-49396760-8ada-44ce-a905-037a84eb30a7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1193 microversion: 2.1 time: 0.259601 Jul 25 05:45:12.666773 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 435/856] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:12 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1193 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:12.795621 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6cb24582-393e-4382-b823-7598d7747d78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:12.814819 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6cb24582-393e-4382-b823-7598d7747d78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:12.816736 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6cb24582-393e-4382-b823-7598d7747d78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:12.818431 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6cb24582-393e-4382-b823-7598d7747d78 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.322980 Jul 25 05:45:12.819522 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 422/857] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:12 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:13.684084 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7330d042-37fb-433c-bc82-68f66740e50c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:13.685070 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7330d042-37fb-433c-bc82-68f66740e50c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:13.692735 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7330d042-37fb-433c-bc82-68f66740e50c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:13.693382 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7330d042-37fb-433c-bc82-68f66740e50c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:13.694140 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7330d042-37fb-433c-bc82-68f66740e50c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:13.694503 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7330d042-37fb-433c-bc82-68f66740e50c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:13.768867 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7330d042-37fb-433c-bc82-68f66740e50c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:13.777318 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7330d042-37fb-433c-bc82-68f66740e50c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1211 microversion: 2.1 time: 0.097184 Jul 25 05:45:13.778786 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 436/858] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:13 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:13.836849 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-33920c98-3c4a-445c-b0ab-0ef742f1255f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:13.838868 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-33920c98-3c4a-445c-b0ab-0ef742f1255f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:13.845326 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33920c98-3c4a-445c-b0ab-0ef742f1255f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:13.845961 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33920c98-3c4a-445c-b0ab-0ef742f1255f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:13.846907 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33920c98-3c4a-445c-b0ab-0ef742f1255f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:13.847506 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33920c98-3c4a-445c-b0ab-0ef742f1255f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:13.986907 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-33920c98-3c4a-445c-b0ab-0ef742f1255f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:13.997718 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-33920c98-3c4a-445c-b0ab-0ef742f1255f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:13.999653 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-33920c98-3c4a-445c-b0ab-0ef742f1255f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:14.000988 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-33920c98-3c4a-445c-b0ab-0ef742f1255f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1806 microversion: 2.20 time: 0.168420 Jul 25 05:45:14.012614 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 423/859] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:13 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:14.796921 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-83c3677b-e961-4969-9bdd-df4ba0cd4e8a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:14.798275 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-83c3677b-e961-4969-9bdd-df4ba0cd4e8a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:14.805691 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-83c3677b-e961-4969-9bdd-df4ba0cd4e8a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:14.806758 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-83c3677b-e961-4969-9bdd-df4ba0cd4e8a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:14.807977 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-83c3677b-e961-4969-9bdd-df4ba0cd4e8a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:14.808668 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-83c3677b-e961-4969-9bdd-df4ba0cd4e8a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:15.019427 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b701b31d-c155-405a-90a8-97d8196d55eb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:15.020038 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b701b31d-c155-405a-90a8-97d8196d55eb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:15.032539 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b701b31d-c155-405a-90a8-97d8196d55eb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:15.035073 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b701b31d-c155-405a-90a8-97d8196d55eb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:15.037304 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b701b31d-c155-405a-90a8-97d8196d55eb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:15.037884 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b701b31d-c155-405a-90a8-97d8196d55eb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:15.110834 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-83c3677b-e961-4969-9bdd-df4ba0cd4e8a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:15.118745 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-83c3677b-e961-4969-9bdd-df4ba0cd4e8a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1211 microversion: 2.1 time: 0.326632 Jul 25 05:45:15.119585 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 437/860] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:14 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1211 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:15.345299 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b701b31d-c155-405a-90a8-97d8196d55eb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:15.358956 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b701b31d-c155-405a-90a8-97d8196d55eb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:15.360625 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b701b31d-c155-405a-90a8-97d8196d55eb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:15.362622 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b701b31d-c155-405a-90a8-97d8196d55eb tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1793 microversion: 2.20 time: 0.346884 Jul 25 05:45:15.363836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 424/861] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:15 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1793 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:16.137759 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d5040178-af30-4076-b0c5-ab9bd459a97a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:16.138572 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d5040178-af30-4076-b0c5-ab9bd459a97a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:16.155026 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d5040178-af30-4076-b0c5-ab9bd459a97a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:16.155519 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d5040178-af30-4076-b0c5-ab9bd459a97a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:16.156333 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d5040178-af30-4076-b0c5-ab9bd459a97a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:16.156818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d5040178-af30-4076-b0c5-ab9bd459a97a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:16.186693 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-617c13f0-911d-4c90-a4ec-54e6b12100d4 req-d1fc0a2a-5a30-4564-81cf-36dd304a998c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b342a18-835a-4975-99f6-8d47fb38676a", "tag": "1a4e76f2-89b4-4926-8f9f-55d7fbf2ba35"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:45:16.209563 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-617c13f0-911d-4c90-a4ec-54e6b12100d4 req-d1fc0a2a-5a30-4564-81cf-36dd304a998c service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:16.211472 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-617c13f0-911d-4c90-a4ec-54e6b12100d4 req-d1fc0a2a-5a30-4564-81cf-36dd304a998c service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:16.434671 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-617c13f0-911d-4c90-a4ec-54e6b12100d4 req-d1fc0a2a-5a30-4564-81cf-36dd304a998c service nova] Creating event network-changed:1a4e76f2-89b4-4926-8f9f-55d7fbf2ba35 for instance 1b342a18-835a-4975-99f6-8d47fb38676a on hv-cinder-85083 Jul 25 05:45:16.445667 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-617c13f0-911d-4c90-a4ec-54e6b12100d4 req-d1fc0a2a-5a30-4564-81cf-36dd304a998c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271701 Jul 25 05:45:16.446486 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 425/862] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:45:16.502514 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d5040178-af30-4076-b0c5-ab9bd459a97a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:16.511193 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d5040178-af30-4076-b0c5-ab9bd459a97a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1267 microversion: 2.1 time: 0.377759 Jul 25 05:45:16.526790 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 438/863] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:16 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1267 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:45:17.535906 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6089a3ca-0a4c-4e5a-9946-30c95ed7b596 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:17.536703 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6089a3ca-0a4c-4e5a-9946-30c95ed7b596 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:17.544330 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6089a3ca-0a4c-4e5a-9946-30c95ed7b596 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:17.544891 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6089a3ca-0a4c-4e5a-9946-30c95ed7b596 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:17.546100 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6089a3ca-0a4c-4e5a-9946-30c95ed7b596 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:17.546735 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6089a3ca-0a4c-4e5a-9946-30c95ed7b596 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:17.753136 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6089a3ca-0a4c-4e5a-9946-30c95ed7b596 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:17.767384 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6089a3ca-0a4c-4e5a-9946-30c95ed7b596 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1267 microversion: 2.1 time: 0.235982 Jul 25 05:45:17.767956 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 426/864] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:17 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:18.783967 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6810c7e3-83a3-4954-a469-e5fb63d00e75 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:18.785301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6810c7e3-83a3-4954-a469-e5fb63d00e75 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:18.792380 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6810c7e3-83a3-4954-a469-e5fb63d00e75 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:18.792855 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6810c7e3-83a3-4954-a469-e5fb63d00e75 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:18.793633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6810c7e3-83a3-4954-a469-e5fb63d00e75 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:18.794218 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6810c7e3-83a3-4954-a469-e5fb63d00e75 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:18.927567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6810c7e3-83a3-4954-a469-e5fb63d00e75 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:18.935676 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6810c7e3-83a3-4954-a469-e5fb63d00e75 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1267 microversion: 2.1 time: 0.155870 Jul 25 05:45:18.936231 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 439/865] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:18 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:19.953092 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d17065cd-a444-4299-bb4f-33cdbb2f8264 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:19.953706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d17065cd-a444-4299-bb4f-33cdbb2f8264 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:19.960503 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d17065cd-a444-4299-bb4f-33cdbb2f8264 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:19.960990 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d17065cd-a444-4299-bb4f-33cdbb2f8264 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:19.961750 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d17065cd-a444-4299-bb4f-33cdbb2f8264 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:19.962188 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d17065cd-a444-4299-bb4f-33cdbb2f8264 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:20.103392 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d17065cd-a444-4299-bb4f-33cdbb2f8264 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:20.111259 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d17065cd-a444-4299-bb4f-33cdbb2f8264 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1267 microversion: 2.1 time: 0.162091 Jul 25 05:45:20.111862 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 427/866] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:19 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:21.128646 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3144815f-b505-43c4-95f5-eb6e5a748205 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:21.129464 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3144815f-b505-43c4-95f5-eb6e5a748205 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:21.138332 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3144815f-b505-43c4-95f5-eb6e5a748205 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:21.138332 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3144815f-b505-43c4-95f5-eb6e5a748205 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:21.138541 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3144815f-b505-43c4-95f5-eb6e5a748205 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:21.138877 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3144815f-b505-43c4-95f5-eb6e5a748205 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:21.274201 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-3144815f-b505-43c4-95f5-eb6e5a748205 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:21.281925 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3144815f-b505-43c4-95f5-eb6e5a748205 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1267 microversion: 2.1 time: 0.157045 Jul 25 05:45:21.282478 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 440/867] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:21 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:22.298282 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-90310d4c-30a2-4475-a10c-d44f92fa0c80 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:22.298890 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-90310d4c-30a2-4475-a10c-d44f92fa0c80 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:22.300881 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:22.302017 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=8 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:22.308441 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-90310d4c-30a2-4475-a10c-d44f92fa0c80 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:22.308926 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-90310d4c-30a2-4475-a10c-d44f92fa0c80 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:22.309690 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-90310d4c-30a2-4475-a10c-d44f92fa0c80 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:22.310152 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-90310d4c-30a2-4475-a10c-d44f92fa0c80 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:22.445445 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-90310d4c-30a2-4475-a10c-d44f92fa0c80 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:22.453131 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-90310d4c-30a2-4475-a10c-d44f92fa0c80 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1267 microversion: 2.1 time: 0.158556 Jul 25 05:45:22.453689 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 428/868] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:22 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:23.472010 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4e2b3b0b-6d69-4e82-a211-9ba8539bff16 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:23.472626 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4e2b3b0b-6d69-4e82-a211-9ba8539bff16 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:23.484105 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e2b3b0b-6d69-4e82-a211-9ba8539bff16 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:23.484645 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e2b3b0b-6d69-4e82-a211-9ba8539bff16 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:23.485651 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e2b3b0b-6d69-4e82-a211-9ba8539bff16 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:23.486330 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4e2b3b0b-6d69-4e82-a211-9ba8539bff16 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:23.765990 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4e2b3b0b-6d69-4e82-a211-9ba8539bff16 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:23.773800 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4e2b3b0b-6d69-4e82-a211-9ba8539bff16 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1267 microversion: 2.1 time: 0.305809 Jul 25 05:45:23.774591 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 441/869] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:23 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1267 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:24.791691 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6ed3dd4c-750c-4d16-b49b-266e61dd6110 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:24.792964 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6ed3dd4c-750c-4d16-b49b-266e61dd6110 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:24.802007 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6ed3dd4c-750c-4d16-b49b-266e61dd6110 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:24.802475 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6ed3dd4c-750c-4d16-b49b-266e61dd6110 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:24.803278 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6ed3dd4c-750c-4d16-b49b-266e61dd6110 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:24.803740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6ed3dd4c-750c-4d16-b49b-266e61dd6110 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:25.037912 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6ed3dd4c-750c-4d16-b49b-266e61dd6110 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:25.055860 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6ed3dd4c-750c-4d16-b49b-266e61dd6110 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1267 microversion: 2.1 time: 0.268442 Jul 25 05:45:25.056625 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 429/870] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:24 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:26.073610 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4ed4657e-4a50-4236-83e1-af8245a6b1e6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:26.074417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4ed4657e-4a50-4236-83e1-af8245a6b1e6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:26.082663 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4ed4657e-4a50-4236-83e1-af8245a6b1e6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:26.083231 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4ed4657e-4a50-4236-83e1-af8245a6b1e6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:26.084087 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4ed4657e-4a50-4236-83e1-af8245a6b1e6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:26.084915 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4ed4657e-4a50-4236-83e1-af8245a6b1e6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:26.331505 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4ed4657e-4a50-4236-83e1-af8245a6b1e6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:26.342294 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4ed4657e-4a50-4236-83e1-af8245a6b1e6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1267 microversion: 2.1 time: 0.273149 Jul 25 05:45:26.352236 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 442/871] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:26 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:27.359649 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8feb7b65-64e0-4ea6-bfb0-66b31376f2ed tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:27.360170 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8feb7b65-64e0-4ea6-bfb0-66b31376f2ed tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:27.366918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8feb7b65-64e0-4ea6-bfb0-66b31376f2ed tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:27.367388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8feb7b65-64e0-4ea6-bfb0-66b31376f2ed tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:27.368178 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8feb7b65-64e0-4ea6-bfb0-66b31376f2ed tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:27.368626 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8feb7b65-64e0-4ea6-bfb0-66b31376f2ed tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:27.552442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8feb7b65-64e0-4ea6-bfb0-66b31376f2ed tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:27.561442 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8feb7b65-64e0-4ea6-bfb0-66b31376f2ed tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1267 microversion: 2.1 time: 0.206013 Jul 25 05:45:27.562309 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 430/872] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:27 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:45:27.638047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-96fac7a0-3d4b-467c-84a5-4af2bbcd22b8 req-79db8f79-ef99-4344-93c1-7b995316b47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b342a18-835a-4975-99f6-8d47fb38676a", "name": "network-vif-plugged", "status": "completed", "tag": "1a4e76f2-89b4-4926-8f9f-55d7fbf2ba35"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:45:27.655339 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-96fac7a0-3d4b-467c-84a5-4af2bbcd22b8 req-79db8f79-ef99-4344-93c1-7b995316b47c service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:27.656028 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-96fac7a0-3d4b-467c-84a5-4af2bbcd22b8 req-79db8f79-ef99-4344-93c1-7b995316b47c service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:27.672756 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-96fac7a0-3d4b-467c-84a5-4af2bbcd22b8 req-79db8f79-ef99-4344-93c1-7b995316b47c service nova] Creating event network-vif-plugged:1a4e76f2-89b4-4926-8f9f-55d7fbf2ba35 for instance 1b342a18-835a-4975-99f6-8d47fb38676a on hv-cinder-85083 Jul 25 05:45:27.680875 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-96fac7a0-3d4b-467c-84a5-4af2bbcd22b8 req-79db8f79-ef99-4344-93c1-7b995316b47c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048708 Jul 25 05:45:27.681973 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 443/873] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:45:28.579165 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a4d75c2a-e963-4e81-bd21-fa4121a99aba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:28.581126 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a4d75c2a-e963-4e81-bd21-fa4121a99aba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:28.593309 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4d75c2a-e963-4e81-bd21-fa4121a99aba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:28.593772 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4d75c2a-e963-4e81-bd21-fa4121a99aba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:28.595053 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4d75c2a-e963-4e81-bd21-fa4121a99aba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:28.595826 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4d75c2a-e963-4e81-bd21-fa4121a99aba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:28.830576 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a4d75c2a-e963-4e81-bd21-fa4121a99aba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:28.834028 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:28.840573 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a4d75c2a-e963-4e81-bd21-fa4121a99aba tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1267 microversion: 2.1 time: 0.265481 Jul 25 05:45:28.841183 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 431/874] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:28 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:29.859467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cf4b3b14-5027-4174-9902-32d5c90b6444 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:29.860165 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-cf4b3b14-5027-4174-9902-32d5c90b6444 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:29.867645 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cf4b3b14-5027-4174-9902-32d5c90b6444 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:29.868250 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cf4b3b14-5027-4174-9902-32d5c90b6444 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:29.869131 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cf4b3b14-5027-4174-9902-32d5c90b6444 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:29.869799 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cf4b3b14-5027-4174-9902-32d5c90b6444 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:30.036321 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cf4b3b14-5027-4174-9902-32d5c90b6444 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:30.049149 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cf4b3b14-5027-4174-9902-32d5c90b6444 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1454 microversion: 2.1 time: 0.194250 Jul 25 05:45:30.061440 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 444/875] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:29 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1454 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:30.068097 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-145f6f9c-9e7d-47e6-afeb-ce5aaf3fb611 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:30.068739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-145f6f9c-9e7d-47e6-afeb-ce5aaf3fb611 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:30.084356 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-145f6f9c-9e7d-47e6-afeb-ce5aaf3fb611 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:30.084935 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-145f6f9c-9e7d-47e6-afeb-ce5aaf3fb611 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:30.085742 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-145f6f9c-9e7d-47e6-afeb-ce5aaf3fb611 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:30.086174 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-145f6f9c-9e7d-47e6-afeb-ce5aaf3fb611 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:30.298024 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-145f6f9c-9e7d-47e6-afeb-ce5aaf3fb611 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:30.306586 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-145f6f9c-9e7d-47e6-afeb-ce5aaf3fb611 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1454 microversion: 2.1 time: 0.243361 Jul 25 05:45:30.325228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 432/876] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:30 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1454 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:33.155210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-04c99ee8-a41e-4552-865f-78d095e4306b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Action: 'create', calling method: .version_select at 0x7fcc840fa8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-873262384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKX9wGtO5qODR6G64F1rtfs6EWVlRxvWOTDEKWT9UfC85ImRug9X7rUSq3XNLPKEl7axPZl4Wje4QUrB/yenT+FkBS5b3MgPRnewYs7Q7D114Syta6MRU5vzZISN4rRMxg=="}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:45:33.176521 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-04c99ee8-a41e-4552-865f-78d095e4306b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Getting quotas for project 354d7ebd6b454fb5a601a2a78a88561e. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:45:33.182356 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-04c99ee8-a41e-4552-865f-78d095e4306b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Getting quotas for user 1574ee677bad49d190a0f82827d5aade and project 354d7ebd6b454fb5a601a2a78a88561e. Resources: {'key_pairs'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:45:33.216600 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-04c99ee8-a41e-4552-865f-78d095e4306b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.383491 Jul 25 05:45:33.217036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 445/877] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 25 05:45:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:45:33.466138 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-001b113d-3623-4390-9644-2fb4227ca4c4 req-2099e758-30f6-4d17-95f0-0350574f42fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b342a18-835a-4975-99f6-8d47fb38676a", "tag": "1a4e76f2-89b4-4926-8f9f-55d7fbf2ba35"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:45:33.475908 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-001b113d-3623-4390-9644-2fb4227ca4c4 req-2099e758-30f6-4d17-95f0-0350574f42fa service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:33.476457 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-001b113d-3623-4390-9644-2fb4227ca4c4 req-2099e758-30f6-4d17-95f0-0350574f42fa service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:33.488991 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-001b113d-3623-4390-9644-2fb4227ca4c4 req-2099e758-30f6-4d17-95f0-0350574f42fa service nova] Creating event network-changed:1a4e76f2-89b4-4926-8f9f-55d7fbf2ba35 for instance 1b342a18-835a-4975-99f6-8d47fb38676a on hv-cinder-85083 Jul 25 05:45:33.496194 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-001b113d-3623-4390-9644-2fb4227ca4c4 req-2099e758-30f6-4d17-95f0-0350574f42fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034107 Jul 25 05:45:33.496959 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 433/878] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:45:51.801268 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=86 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:51.802135 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=4 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:51.802784 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:51.807001 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1403092385", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-873262384", "security_groups": [{"name": "tempest-secgroup-smoke-1628418493"}], "networks": [{"uuid": "152f2c4c-f1d7-4b80-8c66-de0cfa8e3082"}], "block_device_mapping_v2": [{"uuid": "b3a9c7db-700c-449d-bb3c-8417624854a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:45:51.918856 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.network.neutron [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] validate_networks() for [('152f2c4c-f1d7-4b80-8c66-de0cfa8e3082', None, None, None, None, None)] {{(pid=124467) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:45:52.276332 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Flavor limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:45:52.276755 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Image limits 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:45:52.277316 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Flavor pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:45:52.277705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Image pref 0:0:0 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:45:52.278112 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.virt.hardware [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:45:52.287642 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:52.288089 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:52.289088 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:52.289528 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:52.305702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Getting quotas for project 354d7ebd6b454fb5a601a2a78a88561e. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:45:52.309540 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.quota [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Getting quotas for user 1574ee677bad49d190a0f82827d5aade and project 354d7ebd6b454fb5a601a2a78a88561e. Resources: {'instances', 'ram', 'cores'} {{(pid=124467) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:45:52.366211 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Going to run 1 instances... {{(pid=124467) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:45:52.368268 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3a9c7db-700c-449d-bb3c-8417624854a0',volume_size=None,volume_type=None)] {{(pid=124467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:45:52.489798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [d9e5dd56-dac1-4dae-8f60-5e90518a22a3] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 05:45:53.497385 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO oslo.messaging._drivers.impl_rabbit [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [d9e5dd56-dac1-4dae-8f60-5e90518a22a3] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 32834. Jul 25 05:45:53.501247 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-eb2e72ce-9e1b-4539-9143-db6f3bf948c0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.701342 Jul 25 05:45:53.501888 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 446/879] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:45:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:45:53.510003 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:53.510754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=8 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:53.515284 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bb1695d7-06ed-4e68-8cc7-d1f909ba9d09 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:53.516015 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bb1695d7-06ed-4e68-8cc7-d1f909ba9d09 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:53.573293 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bb1695d7-06ed-4e68-8cc7-d1f909ba9d09 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:53.579932 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bb1695d7-06ed-4e68-8cc7-d1f909ba9d09 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1088 microversion: 2.1 time: 0.071801 Jul 25 05:45:53.580496 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 434/880] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:53 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:54.158035 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8b48f3bc-efa6-45f8-8e3d-3c7a4b171a46 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:54.158536 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8b48f3bc-efa6-45f8-8e3d-3c7a4b171a46 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:54.164671 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b48f3bc-efa6-45f8-8e3d-3c7a4b171a46 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:54.165190 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b48f3bc-efa6-45f8-8e3d-3c7a4b171a46 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:54.165963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b48f3bc-efa6-45f8-8e3d-3c7a4b171a46 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:54.166404 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b48f3bc-efa6-45f8-8e3d-3c7a4b171a46 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:54.196726 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8b48f3bc-efa6-45f8-8e3d-3c7a4b171a46 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments/a4603155-f7ef-42d2-b92c-04fbb535a60c" status: 200 len: 194 microversion: 2.20 time: 0.044073 Jul 25 05:45:54.197682 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 447/881] 10.222.0.33 () {60 vars in 1453 bytes} [Mon Jul 25 05:45:54 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments/a4603155-f7ef-42d2-b92c-04fbb535a60c => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:45:54.263732 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5afa0bfe-c860-497c-bca3-a0151558c973 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:54.264325 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5afa0bfe-c860-497c-bca3-a0151558c973 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:54.270687 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5afa0bfe-c860-497c-bca3-a0151558c973 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:54.271133 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5afa0bfe-c860-497c-bca3-a0151558c973 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:54.271947 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5afa0bfe-c860-497c-bca3-a0151558c973 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:54.273048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5afa0bfe-c860-497c-bca3-a0151558c973 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:54.353069 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-5afa0bfe-c860-497c-bca3-a0151558c973 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lazy-loading 'services' on Instance uuid cbb16475-6c9b-4c00-be15-0b5f68b01d0a {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:45:54.432795 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5afa0bfe-c860-497c-bca3-a0151558c973 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments/a4603155-f7ef-42d2-b92c-04fbb535a60c" status: 202 len: 0 microversion: 2.20 time: 0.172769 Jul 25 05:45:54.433404 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 435/882] 10.222.0.33 () {60 vars in 1456 bytes} [Mon Jul 25 05:45:54 2022] DELETE /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments/a4603155-f7ef-42d2-b92c-04fbb535a60c => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:45:54.442783 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-98926913-2146-4faf-9e9c-f257d2bb2959 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:54.443971 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-98926913-2146-4faf-9e9c-f257d2bb2959 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:54.450122 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-98926913-2146-4faf-9e9c-f257d2bb2959 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:54.450576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-98926913-2146-4faf-9e9c-f257d2bb2959 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:54.451336 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-98926913-2146-4faf-9e9c-f257d2bb2959 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:54.451779 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-98926913-2146-4faf-9e9c-f257d2bb2959 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:54.481777 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-98926913-2146-4faf-9e9c-f257d2bb2959 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043432 Jul 25 05:45:54.482312 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 448/883] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jul 25 05:45:54 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:45:54.597465 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1a055fb9-adec-4015-8554-08e6463f7552 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:54.598091 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1a055fb9-adec-4015-8554-08e6463f7552 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:54.604933 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a055fb9-adec-4015-8554-08e6463f7552 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:54.605386 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a055fb9-adec-4015-8554-08e6463f7552 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:54.606173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a055fb9-adec-4015-8554-08e6463f7552 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:54.606610 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a055fb9-adec-4015-8554-08e6463f7552 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:54.670777 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1a055fb9-adec-4015-8554-08e6463f7552 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:54.678746 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1a055fb9-adec-4015-8554-08e6463f7552 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1186 microversion: 2.1 time: 0.085648 Jul 25 05:45:54.679319 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 436/884] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:54 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:55.494055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-71f96a39-8111-41a9-abf0-04daa66e1f23 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:55.494994 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-71f96a39-8111-41a9-abf0-04daa66e1f23 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:55.501473 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-71f96a39-8111-41a9-abf0-04daa66e1f23 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:55.501922 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-71f96a39-8111-41a9-abf0-04daa66e1f23 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:55.502687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-71f96a39-8111-41a9-abf0-04daa66e1f23 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:55.503127 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-71f96a39-8111-41a9-abf0-04daa66e1f23 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:55.532848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-71f96a39-8111-41a9-abf0-04daa66e1f23 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042704 Jul 25 05:45:55.533411 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 449/885] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jul 25 05:45:55 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:45:55.697067 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2f571f28-4035-4b61-aae7-117ba870518b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:55.697724 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2f571f28-4035-4b61-aae7-117ba870518b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:55.704531 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2f571f28-4035-4b61-aae7-117ba870518b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:55.705007 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2f571f28-4035-4b61-aae7-117ba870518b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:55.705781 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2f571f28-4035-4b61-aae7-117ba870518b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:55.706210 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2f571f28-4035-4b61-aae7-117ba870518b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:55.773938 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2f571f28-4035-4b61-aae7-117ba870518b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:55.784945 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2f571f28-4035-4b61-aae7-117ba870518b tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1204 microversion: 2.1 time: 0.092312 Jul 25 05:45:55.785666 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 437/886] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:55 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1204 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:56.545733 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4a8d4f99-b4c2-4bda-b969-9047462f6c0a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:56.546930 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4a8d4f99-b4c2-4bda-b969-9047462f6c0a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:56.561685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4a8d4f99-b4c2-4bda-b969-9047462f6c0a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:56.562144 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4a8d4f99-b4c2-4bda-b969-9047462f6c0a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:56.563912 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4a8d4f99-b4c2-4bda-b969-9047462f6c0a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:56.564444 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4a8d4f99-b4c2-4bda-b969-9047462f6c0a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:56.599541 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4a8d4f99-b4c2-4bda-b969-9047462f6c0a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058972 Jul 25 05:45:56.601042 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 450/887] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jul 25 05:45:56 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:56.666298 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2f26e101-db55-4da9-8849-847e469efc0e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:56.666806 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2f26e101-db55-4da9-8849-847e469efc0e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:56.672976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2f26e101-db55-4da9-8849-847e469efc0e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:56.673438 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2f26e101-db55-4da9-8849-847e469efc0e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:56.674466 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2f26e101-db55-4da9-8849-847e469efc0e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:56.674929 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2f26e101-db55-4da9-8849-847e469efc0e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:56.715090 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2f26e101-db55-4da9-8849-847e469efc0e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:45:56.721448 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-a81961b9-0889-4464-9c36-267cce6e9566 req-827c9510-41c2-4e9d-9054-8eb649da6d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2221cc83-bea9-40a3-8091-ab87d3e19559", "tag": "1046d76f-597e-40e1-a094-544799c676dd"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:45:56.730806 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-a81961b9-0889-4464-9c36-267cce6e9566 req-827c9510-41c2-4e9d-9054-8eb649da6d93 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:56.731530 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-a81961b9-0889-4464-9c36-267cce6e9566 req-827c9510-41c2-4e9d-9054-8eb649da6d93 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:56.754926 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-a81961b9-0889-4464-9c36-267cce6e9566 req-827c9510-41c2-4e9d-9054-8eb649da6d93 service nova] Creating event network-changed:1046d76f-597e-40e1-a094-544799c676dd for instance 2221cc83-bea9-40a3-8091-ab87d3e19559 on hv-cinder-85083 Jul 25 05:45:56.760589 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-a81961b9-0889-4464-9c36-267cce6e9566 req-827c9510-41c2-4e9d-9054-8eb649da6d93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045482 Jul 25 05:45:56.761423 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 451/888] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:45:56.810703 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a7954468-4559-4fdd-8be6-65a3472b6896 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:56.811418 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a7954468-4559-4fdd-8be6-65a3472b6896 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:56.819103 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a7954468-4559-4fdd-8be6-65a3472b6896 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:56.819560 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a7954468-4559-4fdd-8be6-65a3472b6896 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:56.820492 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a7954468-4559-4fdd-8be6-65a3472b6896 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:56.820971 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a7954468-4559-4fdd-8be6-65a3472b6896 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:56.842499 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2f26e101-db55-4da9-8849-847e469efc0e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 204 len: 0 microversion: 2.20 time: 0.180171 Jul 25 05:45:56.844322 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 438/889] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jul 25 05:45:56 2022] DELETE /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 05:45:56.855859 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-029cd4b2-4ac2-4177-bdd3-791626846b73 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:56.856868 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-029cd4b2-4ac2-4177-bdd3-791626846b73 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:56.865481 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-029cd4b2-4ac2-4177-bdd3-791626846b73 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:56.866126 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-029cd4b2-4ac2-4177-bdd3-791626846b73 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:56.867089 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-029cd4b2-4ac2-4177-bdd3-791626846b73 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:56.867706 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-029cd4b2-4ac2-4177-bdd3-791626846b73 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:57.022517 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a7954468-4559-4fdd-8be6-65a3472b6896 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:57.030935 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a7954468-4559-4fdd-8be6-65a3472b6896 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.231526 Jul 25 05:45:57.034676 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 452/890] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:56 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:57.051039 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-029cd4b2-4ac2-4177-bdd3-791626846b73 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:57.058836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-029cd4b2-4ac2-4177-bdd3-791626846b73 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:57.060343 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-029cd4b2-4ac2-4177-bdd3-791626846b73 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:57.061535 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-029cd4b2-4ac2-4177-bdd3-791626846b73 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.212187 Jul 25 05:45:57.062087 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 439/891] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:56 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:45:58.048904 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1898f43f-7e26-4f7d-a2d7-9cb4e07a87a3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:58.049507 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1898f43f-7e26-4f7d-a2d7-9cb4e07a87a3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:58.055926 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1898f43f-7e26-4f7d-a2d7-9cb4e07a87a3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:58.056377 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1898f43f-7e26-4f7d-a2d7-9cb4e07a87a3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:58.057154 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1898f43f-7e26-4f7d-a2d7-9cb4e07a87a3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:58.057585 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1898f43f-7e26-4f7d-a2d7-9cb4e07a87a3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:58.080851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-885af49f-837c-40e2-bcc4-5737d2a77652 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:58.081394 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-885af49f-837c-40e2-bcc4-5737d2a77652 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:58.087877 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-885af49f-837c-40e2-bcc4-5737d2a77652 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:58.088336 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-885af49f-837c-40e2-bcc4-5737d2a77652 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:58.089144 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-885af49f-837c-40e2-bcc4-5737d2a77652 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:58.089589 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-885af49f-837c-40e2-bcc4-5737d2a77652 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:58.257482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1898f43f-7e26-4f7d-a2d7-9cb4e07a87a3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:58.264754 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1898f43f-7e26-4f7d-a2d7-9cb4e07a87a3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.219682 Jul 25 05:45:58.265540 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 453/892] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:58 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:58.268392 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-885af49f-837c-40e2-bcc4-5737d2a77652 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:58.276422 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-885af49f-837c-40e2-bcc4-5737d2a77652 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:58.277967 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-885af49f-837c-40e2-bcc4-5737d2a77652 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:58.279123 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-885af49f-837c-40e2-bcc4-5737d2a77652 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1721 microversion: 2.20 time: 0.202875 Jul 25 05:45:58.279672 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 440/893] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:58 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:45:59.282043 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b30059fc-347b-4406-8095-e6eaeb2a1eaf tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:59.282631 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b30059fc-347b-4406-8095-e6eaeb2a1eaf tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:59.289055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b30059fc-347b-4406-8095-e6eaeb2a1eaf tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:59.289501 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b30059fc-347b-4406-8095-e6eaeb2a1eaf tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:59.290251 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b30059fc-347b-4406-8095-e6eaeb2a1eaf tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:59.290688 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b30059fc-347b-4406-8095-e6eaeb2a1eaf tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:59.300004 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-857bd3cb-543c-41c4-87e3-690f1a7f7ab6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:45:59.300618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-857bd3cb-543c-41c4-87e3-690f1a7f7ab6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:45:59.308017 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-857bd3cb-543c-41c4-87e3-690f1a7f7ab6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:59.308478 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-857bd3cb-543c-41c4-87e3-690f1a7f7ab6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:59.309887 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-857bd3cb-543c-41c4-87e3-690f1a7f7ab6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:59.310337 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-857bd3cb-543c-41c4-87e3-690f1a7f7ab6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:59.400592 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-857bd3cb-543c-41c4-87e3-690f1a7f7ab6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:59.409441 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-857bd3cb-543c-41c4-87e3-690f1a7f7ab6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:59.411125 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-857bd3cb-543c-41c4-87e3-690f1a7f7ab6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:59.413184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-857bd3cb-543c-41c4-87e3-690f1a7f7ab6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1653 microversion: 2.20 time: 0.118695 Jul 25 05:45:59.425027 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 441/894] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:45:59 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1653 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:45:59.480206 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b30059fc-347b-4406-8095-e6eaeb2a1eaf tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:45:59.488013 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b30059fc-347b-4406-8095-e6eaeb2a1eaf tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.210422 Jul 25 05:45:59.488563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 454/895] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:45:59 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:45:59.886339 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-b88a4c28-cf0d-489b-80bd-b465e1038b7b req-c1dae0f9-20dd-481c-98b4-e3872f268a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb16475-6c9b-4c00-be15-0b5f68b01d0a", "name": "network-vif-deleted", "tag": "15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:45:59.898396 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b88a4c28-cf0d-489b-80bd-b465e1038b7b req-c1dae0f9-20dd-481c-98b4-e3872f268a97 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:45:59.899007 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b88a4c28-cf0d-489b-80bd-b465e1038b7b req-c1dae0f9-20dd-481c-98b4-e3872f268a97 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:45:59.911799 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-b88a4c28-cf0d-489b-80bd-b465e1038b7b req-c1dae0f9-20dd-481c-98b4-e3872f268a97 service nova] Creating event network-vif-deleted:15a6d48c-ebb3-4f96-b5e1-47ebdcba10bc for instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a on hv-cinder-85083 Jul 25 05:45:59.936137 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-b88a4c28-cf0d-489b-80bd-b465e1038b7b req-c1dae0f9-20dd-481c-98b4-e3872f268a97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049967 Jul 25 05:45:59.937177 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 442/896] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:46:00.433437 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:00.434741 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:00.442617 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:00.443079 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:00.443952 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:00.444540 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:00.480497 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:00.481247 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:00.481731 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lazy-loading 'fault' on Instance uuid cbb16475-6c9b-4c00-be15-0b5f68b01d0a {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:46:00.506122 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-97bf110e-9402-4227-ada7-949da15e71a1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:00.506820 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-97bf110e-9402-4227-ada7-949da15e71a1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:00.514014 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97bf110e-9402-4227-ada7-949da15e71a1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:00.514829 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97bf110e-9402-4227-ada7-949da15e71a1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:00.515683 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97bf110e-9402-4227-ada7-949da15e71a1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:00.516140 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97bf110e-9402-4227-ada7-949da15e71a1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:00.537126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:00.549526 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:00.557535 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:00.559156 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a9fdfb9d-22d5-4f62-9eb0-ded3de322e29 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 200 len: 1370 microversion: 2.20 time: 0.130666 Jul 25 05:46:00.565235 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 455/897] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:00 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 1370 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:00.664102 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-97bf110e-9402-4227-ada7-949da15e71a1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:00.671745 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-97bf110e-9402-4227-ada7-949da15e71a1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.170244 Jul 25 05:46:00.673030 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 443/898] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:46:00 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:46:01.579015 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-139d4684-029c-4ed6-b7de-9497d73d7cfa tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:01.579627 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-139d4684-029c-4ed6-b7de-9497d73d7cfa tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:01.585745 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-139d4684-029c-4ed6-b7de-9497d73d7cfa tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:01.586200 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-139d4684-029c-4ed6-b7de-9497d73d7cfa tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:01.586971 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-139d4684-029c-4ed6-b7de-9497d73d7cfa tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:01.587445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-139d4684-029c-4ed6-b7de-9497d73d7cfa tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:01.600969 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-139d4684-029c-4ed6-b7de-9497d73d7cfa tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] HTTP exception thrown: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-139d4684-029c-4ed6-b7de-9497d73d7cfa tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Request method failure captured: Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a HTTP/1.1 Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3i1nWqwf9S3Vsl_Ak7ZNQkIQrfDeSJt-DG-fF_KNfd5gISkikp2d5PtYQRHj3K2OhMxd5pJm68OzjNoQrSAkIC9YgfX0L9ztESDy_btjeK1sIJzW8lcxrhrH4t3TgEkBOS1HyRwau94yekrtXCC39EtUN7XoVHWsCB4-z8x4S6xNMQA Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:46:01.602633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_07879d074bee4b36b1f2f661dc4aeb7f"}]}] Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 6973623dc52c402ab51dbf1a7169d3e9 Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:46:01.604673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': 'cbb16475-6c9b-4c00-be15-0b5f68b01d0a'} Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:46:01.605863 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:46:01.607482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:46:01.609748 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-139d4684-029c-4ed6-b7de-9497d73d7cfa tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Returning 404 to user: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:46:01.609748 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-139d4684-029c-4ed6-b7de-9497d73d7cfa tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 404 len: 111 microversion: 2.20 time: 0.029278 Jul 25 05:46:01.609748 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 456/899] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:01 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 05:46:01.615067 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8dca347f-9cbb-426c-ad77-5da55f6d9a72 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '.version_select at 0x7fcc842b3790>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:01.633504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8dca347f-9cbb-426c-ad77-5da55f6d9a72 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-592229990" status: 204 len: 0 microversion: 2.20 time: 0.022206 Jul 25 05:46:01.634069 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 444/900] 10.222.0.33 () {60 vars in 1258 bytes} [Mon Jul 25 05:46:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-592229990 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 05:46:01.690025 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-02c7160b-10a0-466a-800a-b7b0a20fc8ff tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:01.690638 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-02c7160b-10a0-466a-800a-b7b0a20fc8ff tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:01.697963 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-02c7160b-10a0-466a-800a-b7b0a20fc8ff tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:01.698420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-02c7160b-10a0-466a-800a-b7b0a20fc8ff tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:01.699190 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-02c7160b-10a0-466a-800a-b7b0a20fc8ff tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:01.699628 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-02c7160b-10a0-466a-800a-b7b0a20fc8ff tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:01.904865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-02c7160b-10a0-466a-800a-b7b0a20fc8ff tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:01.913332 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-02c7160b-10a0-466a-800a-b7b0a20fc8ff tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.228183 Jul 25 05:46:01.913985 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 457/901] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:46:01 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:46:02.289025 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5d5ba35c-af63-434d-84cc-fbc0976c9518 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Action: 'create', calling method: .version_select at 0x7fcc8432b280>, body: {"keypair": {"name": "tempest-keypair-376698411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAkSsAWLCra7WxS47w51q+xMUwbIaL7WA6KvQKpxQfJN7vmiTBEU90Xz3X7BVM0/N+m4scb4pkmUl2DoApaWi9TuzchvVVoFJvqQYQB4RVqT6wNtRxhf2HPTGCmYdgjNA=="}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:46:02.303294 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-5d5ba35c-af63-434d-84cc-fbc0976c9518 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Getting quotas for project 07879d074bee4b36b1f2f661dc4aeb7f. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:46:02.307017 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-5d5ba35c-af63-434d-84cc-fbc0976c9518 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Getting quotas for user 6973623dc52c402ab51dbf1a7169d3e9 and project 07879d074bee4b36b1f2f661dc4aeb7f. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:46:02.327681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5d5ba35c-af63-434d-84cc-fbc0976c9518 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.042630 Jul 25 05:46:02.328832 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 445/902] 10.222.0.33 () {62 vars in 1199 bytes} [Mon Jul 25 05:46:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 44 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 05:46:02.930789 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7aa7ccea-21e1-4650-945e-34db793fc2df tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:02.931509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7aa7ccea-21e1-4650-945e-34db793fc2df tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:02.933506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=2 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:02.934242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=6 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:02.942477 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7aa7ccea-21e1-4650-945e-34db793fc2df tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:02.942937 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7aa7ccea-21e1-4650-945e-34db793fc2df tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:02.943715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7aa7ccea-21e1-4650-945e-34db793fc2df tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:02.944232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7aa7ccea-21e1-4650-945e-34db793fc2df tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:03.079010 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7aa7ccea-21e1-4650-945e-34db793fc2df tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:03.086508 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7aa7ccea-21e1-4650-945e-34db793fc2df tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.159580 Jul 25 05:46:03.087073 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 458/903] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:46:02 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:46:03.597834 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-731452078", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3bf226e-5490-492a-a2d4-f65b0aace87c"}], "security_groups": [{"name": "tempest-securitygroup--1042681636"}], "key_name": "tempest-keypair-376698411", "user_data": "}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:46:03.695708 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] validate_networks() for [('a3bf226e-5490-492a-a2d4-f65b0aace87c', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:46:04.067761 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:46:04.068193 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:46:04.068676 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:46:04.069123 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:46:04.069541 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:46:04.078891 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:04.079352 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:04.080160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:04.080609 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:04.097241 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Getting quotas for project 07879d074bee4b36b1f2f661dc4aeb7f. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:46:04.101368 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Getting quotas for user 6973623dc52c402ab51dbf1a7169d3e9 and project 07879d074bee4b36b1f2f661dc4aeb7f. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:46:04.103230 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cd9a1a76-c440-4335-a855-bec8718d226d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:04.104099 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-cd9a1a76-c440-4335-a855-bec8718d226d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:04.110602 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd9a1a76-c440-4335-a855-bec8718d226d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:04.111050 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd9a1a76-c440-4335-a855-bec8718d226d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:04.111809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd9a1a76-c440-4335-a855-bec8718d226d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:04.112245 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd9a1a76-c440-4335-a855-bec8718d226d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:04.113052 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:46:04.115316 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:46:04.170465 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c7e4523f-0417-45dd-8444-17ab992a12de tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.577938 Jul 25 05:46:04.171431 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 446/904] 10.222.0.33 () {62 vars in 1187 bytes} [Mon Jul 25 05:46:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 05:46:04.181691 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-aa426255-be41-4d78-87a9-ab3079c407c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:04.182307 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-aa426255-be41-4d78-87a9-ab3079c407c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:04.268703 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa426255-be41-4d78-87a9-ab3079c407c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:04.278015 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa426255-be41-4d78-87a9-ab3079c407c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:04.279543 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa426255-be41-4d78-87a9-ab3079c407c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:04.280689 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-aa426255-be41-4d78-87a9-ab3079c407c9 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1280 microversion: 2.20 time: 0.103106 Jul 25 05:46:04.282219 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 447/905] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:04 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:46:04.301034 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cd9a1a76-c440-4335-a855-bec8718d226d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:04.309124 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cd9a1a76-c440-4335-a855-bec8718d226d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.209549 Jul 25 05:46:04.309824 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 459/906] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:46:04 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:46:05.299073 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-433d97c1-e7ae-4a91-ab5b-6fe50fc05438 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:05.299678 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-433d97c1-e7ae-4a91-ab5b-6fe50fc05438 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:05.306139 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-433d97c1-e7ae-4a91-ab5b-6fe50fc05438 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:05.306589 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-433d97c1-e7ae-4a91-ab5b-6fe50fc05438 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:05.307351 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-433d97c1-e7ae-4a91-ab5b-6fe50fc05438 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:05.307792 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-433d97c1-e7ae-4a91-ab5b-6fe50fc05438 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:05.325122 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2b3fd849-8b54-4aca-8670-84bd507794a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:05.325749 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2b3fd849-8b54-4aca-8670-84bd507794a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:05.332909 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2b3fd849-8b54-4aca-8670-84bd507794a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:05.333362 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2b3fd849-8b54-4aca-8670-84bd507794a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:05.334131 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2b3fd849-8b54-4aca-8670-84bd507794a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:05.334576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2b3fd849-8b54-4aca-8670-84bd507794a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:05.373604 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-433d97c1-e7ae-4a91-ab5b-6fe50fc05438 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:05.381770 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-433d97c1-e7ae-4a91-ab5b-6fe50fc05438 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:05.383307 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-433d97c1-e7ae-4a91-ab5b-6fe50fc05438 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:05.384387 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-433d97c1-e7ae-4a91-ab5b-6fe50fc05438 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1276 microversion: 2.20 time: 0.089200 Jul 25 05:46:05.384960 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 448/907] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:05 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:05.483511 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2b3fd849-8b54-4aca-8670-84bd507794a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:05.491141 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2b3fd849-8b54-4aca-8670-84bd507794a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.169926 Jul 25 05:46:05.491710 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 460/908] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:46:05 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:46:06.402609 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-476a16bb-ce39-4f0c-97ae-a9be4141619d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:06.403222 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-476a16bb-ce39-4f0c-97ae-a9be4141619d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:06.410705 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-476a16bb-ce39-4f0c-97ae-a9be4141619d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:06.411169 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-476a16bb-ce39-4f0c-97ae-a9be4141619d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:06.411940 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-476a16bb-ce39-4f0c-97ae-a9be4141619d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:06.412384 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-476a16bb-ce39-4f0c-97ae-a9be4141619d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:06.474771 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-476a16bb-ce39-4f0c-97ae-a9be4141619d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:06.483071 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-476a16bb-ce39-4f0c-97ae-a9be4141619d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:06.485263 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-476a16bb-ce39-4f0c-97ae-a9be4141619d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:06.486386 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-476a16bb-ce39-4f0c-97ae-a9be4141619d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1338 microversion: 2.20 time: 0.087727 Jul 25 05:46:06.487143 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 449/909] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:06 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1338 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:06.508528 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-da3506c8-9377-4c76-8d6d-c8c107423a68 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:06.509255 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-da3506c8-9377-4c76-8d6d-c8c107423a68 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:06.515495 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-da3506c8-9377-4c76-8d6d-c8c107423a68 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:06.516124 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-da3506c8-9377-4c76-8d6d-c8c107423a68 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:06.516970 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-da3506c8-9377-4c76-8d6d-c8c107423a68 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:06.517407 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-da3506c8-9377-4c76-8d6d-c8c107423a68 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:06.663654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-da3506c8-9377-4c76-8d6d-c8c107423a68 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:06.672400 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-da3506c8-9377-4c76-8d6d-c8c107423a68 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.167669 Jul 25 05:46:06.673120 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 461/910] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:46:06 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:46:07.339142 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-2eac59da-3c2c-43cf-85ff-286b511509b8 req-2d35f76d-f0c4-4774-ae2a-40c0e1517737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cd734fd-ed06-4c5b-828a-e812b5ddec59", "tag": "07fab7eb-0b40-4f15-aaa2-f8ee69446342"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:46:07.350044 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-2eac59da-3c2c-43cf-85ff-286b511509b8 req-2d35f76d-f0c4-4774-ae2a-40c0e1517737 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:07.350558 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-2eac59da-3c2c-43cf-85ff-286b511509b8 req-2d35f76d-f0c4-4774-ae2a-40c0e1517737 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:07.363644 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-2eac59da-3c2c-43cf-85ff-286b511509b8 req-2d35f76d-f0c4-4774-ae2a-40c0e1517737 service nova] Creating event network-changed:07fab7eb-0b40-4f15-aaa2-f8ee69446342 for instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 on hv-cinder-85083 Jul 25 05:46:07.368601 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-2eac59da-3c2c-43cf-85ff-286b511509b8 req-2d35f76d-f0c4-4774-ae2a-40c0e1517737 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032987 Jul 25 05:46:07.369353 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 450/911] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:46:07.505778 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-819ecacb-91e2-438e-9ff3-66a7f8899878 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:07.506399 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-819ecacb-91e2-438e-9ff3-66a7f8899878 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:07.512544 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-819ecacb-91e2-438e-9ff3-66a7f8899878 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:07.513144 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-819ecacb-91e2-438e-9ff3-66a7f8899878 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:07.513855 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-819ecacb-91e2-438e-9ff3-66a7f8899878 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:07.514222 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-819ecacb-91e2-438e-9ff3-66a7f8899878 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:07.652716 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-819ecacb-91e2-438e-9ff3-66a7f8899878 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:07.662308 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-819ecacb-91e2-438e-9ff3-66a7f8899878 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:07.664103 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-819ecacb-91e2-438e-9ff3-66a7f8899878 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:07.665377 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-819ecacb-91e2-438e-9ff3-66a7f8899878 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1406 microversion: 2.20 time: 0.163591 Jul 25 05:46:07.666161 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 462/912] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:07 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:07.690674 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-411a2ddf-3268-4809-9086-74d62e3b69e7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:07.691389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-411a2ddf-3268-4809-9086-74d62e3b69e7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:07.698283 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-411a2ddf-3268-4809-9086-74d62e3b69e7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:07.698740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-411a2ddf-3268-4809-9086-74d62e3b69e7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:07.699849 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-411a2ddf-3268-4809-9086-74d62e3b69e7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:07.700408 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-411a2ddf-3268-4809-9086-74d62e3b69e7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:07.853390 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-411a2ddf-3268-4809-9086-74d62e3b69e7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:07.861696 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-411a2ddf-3268-4809-9086-74d62e3b69e7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.175972 Jul 25 05:46:07.862248 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 451/913] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:46:07 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:46:08.683802 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cd1314fe-cfe4-4325-a107-238feb3e1069 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:08.684432 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-cd1314fe-cfe4-4325-a107-238feb3e1069 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:08.691591 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd1314fe-cfe4-4325-a107-238feb3e1069 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:08.692029 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd1314fe-cfe4-4325-a107-238feb3e1069 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:08.692814 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd1314fe-cfe4-4325-a107-238feb3e1069 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:08.693649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cd1314fe-cfe4-4325-a107-238feb3e1069 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:08.841129 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cd1314fe-cfe4-4325-a107-238feb3e1069 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:08.849619 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cd1314fe-cfe4-4325-a107-238feb3e1069 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:08.851119 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cd1314fe-cfe4-4325-a107-238feb3e1069 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:08.852226 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cd1314fe-cfe4-4325-a107-238feb3e1069 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1406 microversion: 2.20 time: 0.172474 Jul 25 05:46:08.852798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 463/914] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:08 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:08.879464 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-91437ce6-c2b6-4257-b7d4-7f1512a48899 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:08.880081 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-91437ce6-c2b6-4257-b7d4-7f1512a48899 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:08.886628 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91437ce6-c2b6-4257-b7d4-7f1512a48899 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:08.887083 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91437ce6-c2b6-4257-b7d4-7f1512a48899 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:08.887847 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91437ce6-c2b6-4257-b7d4-7f1512a48899 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:08.888289 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91437ce6-c2b6-4257-b7d4-7f1512a48899 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:09.023401 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-91437ce6-c2b6-4257-b7d4-7f1512a48899 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:09.030944 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-91437ce6-c2b6-4257-b7d4-7f1512a48899 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.156470 Jul 25 05:46:09.031677 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 452/915] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:46:08 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:46:09.740088 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-7ad694c2-129c-4008-b150-0add513b5d1d req-9ef4f18d-e949-4e88-8fe5-337673b19e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2221cc83-bea9-40a3-8091-ab87d3e19559", "name": "network-vif-plugged", "status": "completed", "tag": "1046d76f-597e-40e1-a094-544799c676dd"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:46:09.749417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-7ad694c2-129c-4008-b150-0add513b5d1d req-9ef4f18d-e949-4e88-8fe5-337673b19e15 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:09.750018 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-7ad694c2-129c-4008-b150-0add513b5d1d req-9ef4f18d-e949-4e88-8fe5-337673b19e15 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:09.755376 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=100 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:09.763566 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-7ad694c2-129c-4008-b150-0add513b5d1d req-9ef4f18d-e949-4e88-8fe5-337673b19e15 service nova] Creating event network-vif-plugged:1046d76f-597e-40e1-a094-544799c676dd for instance 2221cc83-bea9-40a3-8091-ab87d3e19559 on hv-cinder-85083 Jul 25 05:46:09.774165 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-7ad694c2-129c-4008-b150-0add513b5d1d req-9ef4f18d-e949-4e88-8fe5-337673b19e15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037650 Jul 25 05:46:09.774886 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 464/916] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:46:09.871335 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-45c6f5c0-21db-487b-bc42-51a8c5cecaf7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:09.871863 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-45c6f5c0-21db-487b-bc42-51a8c5cecaf7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:09.878730 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45c6f5c0-21db-487b-bc42-51a8c5cecaf7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:09.879179 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45c6f5c0-21db-487b-bc42-51a8c5cecaf7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:09.879927 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45c6f5c0-21db-487b-bc42-51a8c5cecaf7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:09.880572 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45c6f5c0-21db-487b-bc42-51a8c5cecaf7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:10.023591 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-45c6f5c0-21db-487b-bc42-51a8c5cecaf7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:10.032350 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-45c6f5c0-21db-487b-bc42-51a8c5cecaf7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:10.033906 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-45c6f5c0-21db-487b-bc42-51a8c5cecaf7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:10.035054 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-45c6f5c0-21db-487b-bc42-51a8c5cecaf7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1406 microversion: 2.20 time: 0.167776 Jul 25 05:46:10.035637 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 453/917] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:09 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:10.050006 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-4cb3a6c5-c3e3-4a66-824d-7b4081aaa0b7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:10.050741 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-4cb3a6c5-c3e3-4a66-824d-7b4081aaa0b7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:10.057035 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cb3a6c5-c3e3-4a66-824d-7b4081aaa0b7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:10.057493 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cb3a6c5-c3e3-4a66-824d-7b4081aaa0b7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:10.058265 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cb3a6c5-c3e3-4a66-824d-7b4081aaa0b7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:10.058710 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-4cb3a6c5-c3e3-4a66-824d-7b4081aaa0b7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:10.191256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-4cb3a6c5-c3e3-4a66-824d-7b4081aaa0b7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:10.198590 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-4cb3a6c5-c3e3-4a66-824d-7b4081aaa0b7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1260 microversion: 2.1 time: 0.153836 Jul 25 05:46:10.199153 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 465/918] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:46:10 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:46:11.053943 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b2954798-f1b2-42ad-bb0f-01c2377bd713 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:11.054552 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b2954798-f1b2-42ad-bb0f-01c2377bd713 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:11.061036 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b2954798-f1b2-42ad-bb0f-01c2377bd713 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:11.061491 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b2954798-f1b2-42ad-bb0f-01c2377bd713 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:11.062245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b2954798-f1b2-42ad-bb0f-01c2377bd713 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:11.062681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b2954798-f1b2-42ad-bb0f-01c2377bd713 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:11.066636 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:11.216651 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-eaf7fa81-7331-4556-8501-d15e68348ca0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:11.218370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-eaf7fa81-7331-4556-8501-d15e68348ca0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:11.220504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b2954798-f1b2-42ad-bb0f-01c2377bd713 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:11.227951 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eaf7fa81-7331-4556-8501-d15e68348ca0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:11.228411 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eaf7fa81-7331-4556-8501-d15e68348ca0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:11.229500 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eaf7fa81-7331-4556-8501-d15e68348ca0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:11.229975 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-eaf7fa81-7331-4556-8501-d15e68348ca0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:11.230359 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b2954798-f1b2-42ad-bb0f-01c2377bd713 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:11.231879 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b2954798-f1b2-42ad-bb0f-01c2377bd713 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:11.233053 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b2954798-f1b2-42ad-bb0f-01c2377bd713 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1406 microversion: 2.20 time: 0.182925 Jul 25 05:46:11.233677 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 454/919] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:11 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:11.374475 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-eaf7fa81-7331-4556-8501-d15e68348ca0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:11.382836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-eaf7fa81-7331-4556-8501-d15e68348ca0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1444 microversion: 2.1 time: 0.170250 Jul 25 05:46:11.383404 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 466/920] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:46:11 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1444 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:46:11.400539 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3192e9f6-b1d2-4294-9fa7-b377b93639cd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:11.401195 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3192e9f6-b1d2-4294-9fa7-b377b93639cd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:11.410385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3192e9f6-b1d2-4294-9fa7-b377b93639cd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:11.411019 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3192e9f6-b1d2-4294-9fa7-b377b93639cd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:11.411851 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3192e9f6-b1d2-4294-9fa7-b377b93639cd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:11.412297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3192e9f6-b1d2-4294-9fa7-b377b93639cd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:11.558868 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3192e9f6-b1d2-4294-9fa7-b377b93639cd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:11.567942 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3192e9f6-b1d2-4294-9fa7-b377b93639cd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1444 microversion: 2.1 time: 0.171645 Jul 25 05:46:11.568489 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 455/921] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:46:11 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1444 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:46:12.251725 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8301e17d-9f4f-431c-b3ba-5844d4938916 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:12.252355 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8301e17d-9f4f-431c-b3ba-5844d4938916 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:12.258888 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8301e17d-9f4f-431c-b3ba-5844d4938916 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:12.259344 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8301e17d-9f4f-431c-b3ba-5844d4938916 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:12.260123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8301e17d-9f4f-431c-b3ba-5844d4938916 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:12.260567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8301e17d-9f4f-431c-b3ba-5844d4938916 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:12.398949 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8301e17d-9f4f-431c-b3ba-5844d4938916 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:12.406911 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8301e17d-9f4f-431c-b3ba-5844d4938916 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:12.408602 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8301e17d-9f4f-431c-b3ba-5844d4938916 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:12.409758 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8301e17d-9f4f-431c-b3ba-5844d4938916 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1406 microversion: 2.20 time: 0.162233 Jul 25 05:46:12.410328 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 467/922] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:12 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:13.429274 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-460880f9-4ee0-455e-bdb7-db78b34e1ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:13.429881 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-460880f9-4ee0-455e-bdb7-db78b34e1ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:13.436942 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-460880f9-4ee0-455e-bdb7-db78b34e1ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:13.437431 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-460880f9-4ee0-455e-bdb7-db78b34e1ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:13.438243 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-460880f9-4ee0-455e-bdb7-db78b34e1ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:13.438709 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-460880f9-4ee0-455e-bdb7-db78b34e1ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:13.480987 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-edb071ca-abe8-4455-8e2d-042e78c9effe req-a178dd5b-ac03-4617-bbfc-546eb30e24d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2221cc83-bea9-40a3-8091-ab87d3e19559", "tag": "1046d76f-597e-40e1-a094-544799c676dd"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:46:13.495778 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-edb071ca-abe8-4455-8e2d-042e78c9effe req-a178dd5b-ac03-4617-bbfc-546eb30e24d4 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:13.496225 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-edb071ca-abe8-4455-8e2d-042e78c9effe req-a178dd5b-ac03-4617-bbfc-546eb30e24d4 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:13.508475 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-edb071ca-abe8-4455-8e2d-042e78c9effe req-a178dd5b-ac03-4617-bbfc-546eb30e24d4 service nova] Creating event network-changed:1046d76f-597e-40e1-a094-544799c676dd for instance 2221cc83-bea9-40a3-8091-ab87d3e19559 on hv-cinder-85083 Jul 25 05:46:13.513447 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-edb071ca-abe8-4455-8e2d-042e78c9effe req-a178dd5b-ac03-4617-bbfc-546eb30e24d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036109 Jul 25 05:46:13.514603 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 468/923] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:46:13.589291 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-460880f9-4ee0-455e-bdb7-db78b34e1ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:13.599319 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-460880f9-4ee0-455e-bdb7-db78b34e1ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:13.600854 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-460880f9-4ee0-455e-bdb7-db78b34e1ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:13.602231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-460880f9-4ee0-455e-bdb7-db78b34e1ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1406 microversion: 2.20 time: 0.178052 Jul 25 05:46:13.603111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 456/924] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:13 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:13.929513 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-76b92e98-eabe-47cc-9846-26275981e567 req-0b3b2c99-c10e-4fba-9f98-2805e4b82612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd734fd-ed06-4c5b-828a-e812b5ddec59", "name": "network-vif-plugged", "status": "completed", "tag": "07fab7eb-0b40-4f15-aaa2-f8ee69446342"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:46:13.937613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-76b92e98-eabe-47cc-9846-26275981e567 req-0b3b2c99-c10e-4fba-9f98-2805e4b82612 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:13.938457 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-76b92e98-eabe-47cc-9846-26275981e567 req-0b3b2c99-c10e-4fba-9f98-2805e4b82612 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:13.950023 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-76b92e98-eabe-47cc-9846-26275981e567 req-0b3b2c99-c10e-4fba-9f98-2805e4b82612 service nova] Creating event network-vif-plugged:07fab7eb-0b40-4f15-aaa2-f8ee69446342 for instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 on hv-cinder-85083 Jul 25 05:46:13.955335 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-76b92e98-eabe-47cc-9846-26275981e567 req-0b3b2c99-c10e-4fba-9f98-2805e4b82612 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029728 Jul 25 05:46:13.956340 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 469/925] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:46:14.622224 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d3eaf27a-1953-4f42-b324-6bf55453c572 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:14.622855 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d3eaf27a-1953-4f42-b324-6bf55453c572 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:14.624682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:14.625389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=14 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:14.633018 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d3eaf27a-1953-4f42-b324-6bf55453c572 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:14.633478 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d3eaf27a-1953-4f42-b324-6bf55453c572 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:14.634249 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d3eaf27a-1953-4f42-b324-6bf55453c572 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:14.634689 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d3eaf27a-1953-4f42-b324-6bf55453c572 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:14.776681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d3eaf27a-1953-4f42-b324-6bf55453c572 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:14.785363 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d3eaf27a-1953-4f42-b324-6bf55453c572 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:14.786884 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d3eaf27a-1953-4f42-b324-6bf55453c572 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:14.787992 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d3eaf27a-1953-4f42-b324-6bf55453c572 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1406 microversion: 2.20 time: 0.169772 Jul 25 05:46:14.788650 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 457/926] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:14 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:15.811948 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-133932a4-9432-4932-b20a-ed0d277e73bf tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:15.812645 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-133932a4-9432-4932-b20a-ed0d277e73bf tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:15.819473 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-133932a4-9432-4932-b20a-ed0d277e73bf tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:15.819923 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-133932a4-9432-4932-b20a-ed0d277e73bf tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:15.820687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-133932a4-9432-4932-b20a-ed0d277e73bf tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:15.821143 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-133932a4-9432-4932-b20a-ed0d277e73bf tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:15.965089 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-133932a4-9432-4932-b20a-ed0d277e73bf tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:15.973749 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-133932a4-9432-4932-b20a-ed0d277e73bf tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:15.975352 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-133932a4-9432-4932-b20a-ed0d277e73bf tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:15.976459 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-133932a4-9432-4932-b20a-ed0d277e73bf tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1406 microversion: 2.20 time: 0.169286 Jul 25 05:46:15.977055 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 470/927] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:15 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:16.995446 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d1e338ce-1ff4-4d1a-9252-2aa51ba873ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:16.995970 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d1e338ce-1ff4-4d1a-9252-2aa51ba873ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:17.003208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e338ce-1ff4-4d1a-9252-2aa51ba873ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:17.003683 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e338ce-1ff4-4d1a-9252-2aa51ba873ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:17.004548 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e338ce-1ff4-4d1a-9252-2aa51ba873ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:17.005012 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e338ce-1ff4-4d1a-9252-2aa51ba873ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:17.133783 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d1e338ce-1ff4-4d1a-9252-2aa51ba873ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:17.141491 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d1e338ce-1ff4-4d1a-9252-2aa51ba873ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:17.143053 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d1e338ce-1ff4-4d1a-9252-2aa51ba873ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:17.144219 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d1e338ce-1ff4-4d1a-9252-2aa51ba873ae tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1598 microversion: 2.20 time: 0.152747 Jul 25 05:46:17.144746 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 458/928] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:16 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:17.161069 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5eb5cc18-9c22-4adb-bc07-2ceeac02776f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:17.161633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5eb5cc18-9c22-4adb-bc07-2ceeac02776f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:17.168204 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5eb5cc18-9c22-4adb-bc07-2ceeac02776f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:17.168650 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5eb5cc18-9c22-4adb-bc07-2ceeac02776f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:17.169448 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5eb5cc18-9c22-4adb-bc07-2ceeac02776f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:17.169878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5eb5cc18-9c22-4adb-bc07-2ceeac02776f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:17.247681 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5eb5cc18-9c22-4adb-bc07-2ceeac02776f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090413 Jul 25 05:46:17.248267 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 471/929] 10.222.0.33 () {60 vars in 1315 bytes} [Mon Jul 25 05:46:17 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:46:18.176377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-a80faefc-564a-4368-b5e8-dada62691370 req-1166b6aa-5871-464b-9684-082e70011cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cd734fd-ed06-4c5b-828a-e812b5ddec59", "tag": "07fab7eb-0b40-4f15-aaa2-f8ee69446342"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:46:18.184700 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a80faefc-564a-4368-b5e8-dada62691370 req-1166b6aa-5871-464b-9684-082e70011cc7 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:18.185189 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a80faefc-564a-4368-b5e8-dada62691370 req-1166b6aa-5871-464b-9684-082e70011cc7 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:18.196582 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-a80faefc-564a-4368-b5e8-dada62691370 req-1166b6aa-5871-464b-9684-082e70011cc7 service nova] Creating event network-changed:07fab7eb-0b40-4f15-aaa2-f8ee69446342 for instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 on hv-cinder-85083 Jul 25 05:46:18.201585 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-a80faefc-564a-4368-b5e8-dada62691370 req-1166b6aa-5871-464b-9684-082e70011cc7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029352 Jul 25 05:46:18.202390 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 459/930] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:46:52.437867 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:52.438614 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=32 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:52.442589 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1380c2ab-25d4-44e4-82eb-b0d49ee3d627 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:52.443589 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1380c2ab-25d4-44e4-82eb-b0d49ee3d627 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:52.450685 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1380c2ab-25d4-44e4-82eb-b0d49ee3d627 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:52.451132 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1380c2ab-25d4-44e4-82eb-b0d49ee3d627 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:52.451915 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1380c2ab-25d4-44e4-82eb-b0d49ee3d627 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:52.452372 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1380c2ab-25d4-44e4-82eb-b0d49ee3d627 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:52.475177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1380c2ab-25d4-44e4-82eb-b0d49ee3d627 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/ips" status: 200 len: 152 microversion: 2.20 time: 0.038864 Jul 25 05:46:52.475720 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 472/931] 10.222.0.33 () {60 vars in 1288 bytes} [Mon Jul 25 05:46:52 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:46:54.930162 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:54.930900 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=30 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:54.935504 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7aee68c2-1dfd-4325-a167-465c0f3dc917 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:46:54.936136 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7aee68c2-1dfd-4325-a167-465c0f3dc917 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:54.944487 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7aee68c2-1dfd-4325-a167-465c0f3dc917 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:54.945005 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7aee68c2-1dfd-4325-a167-465c0f3dc917 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:54.945822 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7aee68c2-1dfd-4325-a167-465c0f3dc917 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:54.946225 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7aee68c2-1dfd-4325-a167-465c0f3dc917 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:54.970796 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-7aee68c2-1dfd-4325-a167-465c0f3dc917 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lazy-loading 'flavor' on Instance uuid 7cd734fd-ed06-4c5b-828a-e812b5ddec59 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:46:55.224065 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7aee68c2-1dfd-4325-a167-465c0f3dc917 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "POST /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/action" status: 202 len: 0 microversion: 2.20 time: 0.295463 Jul 25 05:46:55.225494 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 460/932] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jul 25 05:46:54 2022] POST /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:46:55.234466 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8fc9e963-ae7f-446e-9d93-1c7e18c8cf3b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:55.235289 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8fc9e963-ae7f-446e-9d93-1c7e18c8cf3b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:55.242757 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8fc9e963-ae7f-446e-9d93-1c7e18c8cf3b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:55.243210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8fc9e963-ae7f-446e-9d93-1c7e18c8cf3b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:55.244218 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8fc9e963-ae7f-446e-9d93-1c7e18c8cf3b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:55.244752 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8fc9e963-ae7f-446e-9d93-1c7e18c8cf3b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:55.382989 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8fc9e963-ae7f-446e-9d93-1c7e18c8cf3b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:55.390828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8fc9e963-ae7f-446e-9d93-1c7e18c8cf3b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:55.392335 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8fc9e963-ae7f-446e-9d93-1c7e18c8cf3b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:55.393516 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8fc9e963-ae7f-446e-9d93-1c7e18c8cf3b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.163880 Jul 25 05:46:55.394074 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 473/933] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:55 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:56.414642 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3b88b0d9-c617-4fdf-b929-6d71091f8ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:56.415348 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3b88b0d9-c617-4fdf-b929-6d71091f8ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:56.421673 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b88b0d9-c617-4fdf-b929-6d71091f8ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:56.422129 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b88b0d9-c617-4fdf-b929-6d71091f8ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:56.422898 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b88b0d9-c617-4fdf-b929-6d71091f8ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:56.423338 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b88b0d9-c617-4fdf-b929-6d71091f8ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:56.550359 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3b88b0d9-c617-4fdf-b929-6d71091f8ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:56.558863 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3b88b0d9-c617-4fdf-b929-6d71091f8ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:56.560384 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3b88b0d9-c617-4fdf-b929-6d71091f8ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:56.561575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3b88b0d9-c617-4fdf-b929-6d71091f8ada tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.152882 Jul 25 05:46:56.562125 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 461/934] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:56 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:57.580048 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6c736a26-3094-49b4-97fb-ae518f9116fc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:57.580658 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6c736a26-3094-49b4-97fb-ae518f9116fc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:57.588030 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6c736a26-3094-49b4-97fb-ae518f9116fc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:57.588486 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6c736a26-3094-49b4-97fb-ae518f9116fc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:57.589280 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6c736a26-3094-49b4-97fb-ae518f9116fc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:57.589721 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6c736a26-3094-49b4-97fb-ae518f9116fc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:57.723223 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6c736a26-3094-49b4-97fb-ae518f9116fc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:57.731745 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6c736a26-3094-49b4-97fb-ae518f9116fc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:57.733551 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6c736a26-3094-49b4-97fb-ae518f9116fc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:57.734699 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6c736a26-3094-49b4-97fb-ae518f9116fc tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.158543 Jul 25 05:46:57.735246 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 474/935] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:57 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:58.753366 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1c1fc769-01d2-4429-a369-98751b961c07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:58.753974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1c1fc769-01d2-4429-a369-98751b961c07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:58.760565 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c1fc769-01d2-4429-a369-98751b961c07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:58.761052 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c1fc769-01d2-4429-a369-98751b961c07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:58.761807 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c1fc769-01d2-4429-a369-98751b961c07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:58.762247 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c1fc769-01d2-4429-a369-98751b961c07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:58.893836 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1c1fc769-01d2-4429-a369-98751b961c07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:58.902622 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1c1fc769-01d2-4429-a369-98751b961c07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:58.904146 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1c1fc769-01d2-4429-a369-98751b961c07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:46:58.905358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1c1fc769-01d2-4429-a369-98751b961c07 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.155859 Jul 25 05:46:58.905915 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 462/936] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:58 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:46:59.923690 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d71e1c10-62ee-4878-8468-45b58596a440 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:46:59.924333 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d71e1c10-62ee-4878-8468-45b58596a440 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:46:59.930841 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d71e1c10-62ee-4878-8468-45b58596a440 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:59.931301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d71e1c10-62ee-4878-8468-45b58596a440 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:46:59.932071 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d71e1c10-62ee-4878-8468-45b58596a440 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:46:59.932521 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d71e1c10-62ee-4878-8468-45b58596a440 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:00.069692 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d71e1c10-62ee-4878-8468-45b58596a440 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:00.077617 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d71e1c10-62ee-4878-8468-45b58596a440 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:00.079144 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d71e1c10-62ee-4878-8468-45b58596a440 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:00.080307 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d71e1c10-62ee-4878-8468-45b58596a440 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.160602 Jul 25 05:47:00.080881 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 475/937] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:46:59 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:01.098810 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b824decc-3da6-4949-88e3-73cbfa1af9ed tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:01.099418 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b824decc-3da6-4949-88e3-73cbfa1af9ed tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:01.106316 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b824decc-3da6-4949-88e3-73cbfa1af9ed tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:01.106767 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b824decc-3da6-4949-88e3-73cbfa1af9ed tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:01.107776 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b824decc-3da6-4949-88e3-73cbfa1af9ed tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:01.108212 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b824decc-3da6-4949-88e3-73cbfa1af9ed tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:01.233854 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b824decc-3da6-4949-88e3-73cbfa1af9ed tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:01.242704 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b824decc-3da6-4949-88e3-73cbfa1af9ed tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:01.244223 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b824decc-3da6-4949-88e3-73cbfa1af9ed tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:01.245415 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b824decc-3da6-4949-88e3-73cbfa1af9ed tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.150507 Jul 25 05:47:01.245969 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 463/938] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:01 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:02.263417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-575a7309-4f05-463c-a89c-4177b2966032 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:02.263962 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-575a7309-4f05-463c-a89c-4177b2966032 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:02.270422 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-575a7309-4f05-463c-a89c-4177b2966032 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:02.270876 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-575a7309-4f05-463c-a89c-4177b2966032 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:02.271743 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-575a7309-4f05-463c-a89c-4177b2966032 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:02.272622 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-575a7309-4f05-463c-a89c-4177b2966032 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:02.402620 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-575a7309-4f05-463c-a89c-4177b2966032 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:02.410542 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-575a7309-4f05-463c-a89c-4177b2966032 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:02.412039 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-575a7309-4f05-463c-a89c-4177b2966032 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:02.413965 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-575a7309-4f05-463c-a89c-4177b2966032 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.154503 Jul 25 05:47:02.414520 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 476/939] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:02 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:03.432188 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-295f0364-b95c-41ab-8713-a8e754de6c2f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:03.432828 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-295f0364-b95c-41ab-8713-a8e754de6c2f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:03.439231 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-295f0364-b95c-41ab-8713-a8e754de6c2f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:03.439691 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-295f0364-b95c-41ab-8713-a8e754de6c2f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:03.440462 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-295f0364-b95c-41ab-8713-a8e754de6c2f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:03.440947 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-295f0364-b95c-41ab-8713-a8e754de6c2f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:03.570892 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-295f0364-b95c-41ab-8713-a8e754de6c2f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:03.578754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-295f0364-b95c-41ab-8713-a8e754de6c2f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:03.580307 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-295f0364-b95c-41ab-8713-a8e754de6c2f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:03.581513 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-295f0364-b95c-41ab-8713-a8e754de6c2f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.154036 Jul 25 05:47:03.582066 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 464/940] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:03 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:04.601079 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f9ea8142-2382-4989-bc1b-d5c1f5a70da4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:04.601702 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f9ea8142-2382-4989-bc1b-d5c1f5a70da4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:04.608458 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f9ea8142-2382-4989-bc1b-d5c1f5a70da4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:04.609009 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f9ea8142-2382-4989-bc1b-d5c1f5a70da4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:04.609776 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f9ea8142-2382-4989-bc1b-d5c1f5a70da4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:04.610219 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f9ea8142-2382-4989-bc1b-d5c1f5a70da4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:04.738396 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f9ea8142-2382-4989-bc1b-d5c1f5a70da4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:04.747378 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f9ea8142-2382-4989-bc1b-d5c1f5a70da4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:04.748919 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f9ea8142-2382-4989-bc1b-d5c1f5a70da4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:04.750078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f9ea8142-2382-4989-bc1b-d5c1f5a70da4 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.153923 Jul 25 05:47:04.750628 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 477/941] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:04 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:05.768128 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-007dbb33-9242-4cb3-bd9c-7fc1feae9881 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:05.768763 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-007dbb33-9242-4cb3-bd9c-7fc1feae9881 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:05.776110 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-007dbb33-9242-4cb3-bd9c-7fc1feae9881 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:05.776560 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-007dbb33-9242-4cb3-bd9c-7fc1feae9881 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:05.777349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-007dbb33-9242-4cb3-bd9c-7fc1feae9881 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:05.777786 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-007dbb33-9242-4cb3-bd9c-7fc1feae9881 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:05.906138 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-007dbb33-9242-4cb3-bd9c-7fc1feae9881 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:05.914841 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-007dbb33-9242-4cb3-bd9c-7fc1feae9881 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:05.916358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-007dbb33-9242-4cb3-bd9c-7fc1feae9881 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:05.917589 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-007dbb33-9242-4cb3-bd9c-7fc1feae9881 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.153361 Jul 25 05:47:05.918149 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 465/942] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:05 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:06.936065 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b71c445a-8418-494c-9a7b-fc358f035c7b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:06.936649 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b71c445a-8418-494c-9a7b-fc358f035c7b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:06.943189 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b71c445a-8418-494c-9a7b-fc358f035c7b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:06.943918 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b71c445a-8418-494c-9a7b-fc358f035c7b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:06.944750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b71c445a-8418-494c-9a7b-fc358f035c7b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:06.945216 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b71c445a-8418-494c-9a7b-fc358f035c7b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:07.075030 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b71c445a-8418-494c-9a7b-fc358f035c7b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:07.082856 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b71c445a-8418-494c-9a7b-fc358f035c7b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:07.084383 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b71c445a-8418-494c-9a7b-fc358f035c7b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:07.085573 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b71c445a-8418-494c-9a7b-fc358f035c7b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1744 microversion: 2.20 time: 0.153539 Jul 25 05:47:07.086121 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 478/943] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:06 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:08.103406 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-131e8c4f-a8ff-4d28-8d15-27442dac90ac tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:08.104016 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-131e8c4f-a8ff-4d28-8d15-27442dac90ac tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:08.111184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-131e8c4f-a8ff-4d28-8d15-27442dac90ac tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:08.111643 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-131e8c4f-a8ff-4d28-8d15-27442dac90ac tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:08.112400 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-131e8c4f-a8ff-4d28-8d15-27442dac90ac tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:08.112865 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-131e8c4f-a8ff-4d28-8d15-27442dac90ac tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:08.297748 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-131e8c4f-a8ff-4d28-8d15-27442dac90ac tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:08.307372 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-131e8c4f-a8ff-4d28-8d15-27442dac90ac tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:08.308902 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-131e8c4f-a8ff-4d28-8d15-27442dac90ac tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:08.310061 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-131e8c4f-a8ff-4d28-8d15-27442dac90ac tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1744 microversion: 2.20 time: 0.210571 Jul 25 05:47:08.310620 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 466/944] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:08 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:09.330047 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-19bede6b-17a8-4f1e-beb2-fecd7c68e5a3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:09.331036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-19bede6b-17a8-4f1e-beb2-fecd7c68e5a3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:09.347249 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-19bede6b-17a8-4f1e-beb2-fecd7c68e5a3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:09.347984 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-19bede6b-17a8-4f1e-beb2-fecd7c68e5a3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:09.349572 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-19bede6b-17a8-4f1e-beb2-fecd7c68e5a3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:09.349572 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-19bede6b-17a8-4f1e-beb2-fecd7c68e5a3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:09.520742 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-19bede6b-17a8-4f1e-beb2-fecd7c68e5a3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:09.532400 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-19bede6b-17a8-4f1e-beb2-fecd7c68e5a3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:09.534453 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-19bede6b-17a8-4f1e-beb2-fecd7c68e5a3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:09.535893 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-19bede6b-17a8-4f1e-beb2-fecd7c68e5a3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1739 microversion: 2.20 time: 0.210810 Jul 25 05:47:09.536670 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 479/945] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:09 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:09.988475 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-d5aa2eaa-4302-41bd-ac92-d9edc06df091 req-88eb14ea-e2d0-488c-804b-ac4f1d6fc890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd734fd-ed06-4c5b-828a-e812b5ddec59", "name": "network-vif-plugged", "status": "completed", "tag": "07fab7eb-0b40-4f15-aaa2-f8ee69446342"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:47:10.000213 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-d5aa2eaa-4302-41bd-ac92-d9edc06df091 req-88eb14ea-e2d0-488c-804b-ac4f1d6fc890 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:10.000798 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-d5aa2eaa-4302-41bd-ac92-d9edc06df091 req-88eb14ea-e2d0-488c-804b-ac4f1d6fc890 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:10.017843 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-d5aa2eaa-4302-41bd-ac92-d9edc06df091 req-88eb14ea-e2d0-488c-804b-ac4f1d6fc890 service nova] Creating event network-vif-plugged:07fab7eb-0b40-4f15-aaa2-f8ee69446342 for instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 on hv-cinder-85083 Jul 25 05:47:10.023704 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-d5aa2eaa-4302-41bd-ac92-d9edc06df091 req-88eb14ea-e2d0-488c-804b-ac4f1d6fc890 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041991 Jul 25 05:47:10.024673 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 467/946] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:47:10.558231 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a83bc4c7-a3e8-4bab-bd4e-22f6cbfca936 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:10.559039 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a83bc4c7-a3e8-4bab-bd4e-22f6cbfca936 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:10.566179 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a83bc4c7-a3e8-4bab-bd4e-22f6cbfca936 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:10.566694 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a83bc4c7-a3e8-4bab-bd4e-22f6cbfca936 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:10.567463 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a83bc4c7-a3e8-4bab-bd4e-22f6cbfca936 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:10.567898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a83bc4c7-a3e8-4bab-bd4e-22f6cbfca936 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:10.797715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a83bc4c7-a3e8-4bab-bd4e-22f6cbfca936 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:10.813467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a83bc4c7-a3e8-4bab-bd4e-22f6cbfca936 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:10.815137 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a83bc4c7-a3e8-4bab-bd4e-22f6cbfca936 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:10.816316 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a83bc4c7-a3e8-4bab-bd4e-22f6cbfca936 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1739 microversion: 2.20 time: 0.262288 Jul 25 05:47:10.817317 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 480/947] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:10 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:11.837066 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-38dcb1eb-51d6-4741-a599-ac4b01804573 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:11.839193 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-38dcb1eb-51d6-4741-a599-ac4b01804573 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:11.846056 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-38dcb1eb-51d6-4741-a599-ac4b01804573 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:11.846514 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-38dcb1eb-51d6-4741-a599-ac4b01804573 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:11.847299 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-38dcb1eb-51d6-4741-a599-ac4b01804573 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:11.847743 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-38dcb1eb-51d6-4741-a599-ac4b01804573 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:12.014918 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-38dcb1eb-51d6-4741-a599-ac4b01804573 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:12.024832 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-38dcb1eb-51d6-4741-a599-ac4b01804573 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:12.026674 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-38dcb1eb-51d6-4741-a599-ac4b01804573 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:12.027848 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-38dcb1eb-51d6-4741-a599-ac4b01804573 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1739 microversion: 2.20 time: 0.196129 Jul 25 05:47:12.028407 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 468/948] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:11 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:13.047244 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2044a91a-2d16-43e6-967f-48e2ab60cc0f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:13.049123 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2044a91a-2d16-43e6-967f-48e2ab60cc0f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:13.057535 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2044a91a-2d16-43e6-967f-48e2ab60cc0f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:13.058825 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2044a91a-2d16-43e6-967f-48e2ab60cc0f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:13.059859 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2044a91a-2d16-43e6-967f-48e2ab60cc0f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:13.060552 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2044a91a-2d16-43e6-967f-48e2ab60cc0f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:13.214541 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2044a91a-2d16-43e6-967f-48e2ab60cc0f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:13.227282 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2044a91a-2d16-43e6-967f-48e2ab60cc0f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:13.229231 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2044a91a-2d16-43e6-967f-48e2ab60cc0f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:13.230528 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2044a91a-2d16-43e6-967f-48e2ab60cc0f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1739 microversion: 2.20 time: 0.187583 Jul 25 05:47:13.241856 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 481/949] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:13 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:14.044115 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4da92964-74f8-46a6-82f8-afa1476f8e22 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:14.046013 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-923692c0-2b28-4b3e-a7e7-e319ea31c566 req-6ea80d97-5764-428e-ab63-194d4fdf285e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b342a18-835a-4975-99f6-8d47fb38676a", "tag": "1a4e76f2-89b4-4926-8f9f-55d7fbf2ba35"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:47:14.052052 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4da92964-74f8-46a6-82f8-afa1476f8e22 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:14.060197 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4da92964-74f8-46a6-82f8-afa1476f8e22 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:14.065454 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-923692c0-2b28-4b3e-a7e7-e319ea31c566 req-6ea80d97-5764-428e-ab63-194d4fdf285e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:14.066766 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4da92964-74f8-46a6-82f8-afa1476f8e22 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:14.067612 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4da92964-74f8-46a6-82f8-afa1476f8e22 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:14.068109 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4da92964-74f8-46a6-82f8-afa1476f8e22 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:14.071614 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-923692c0-2b28-4b3e-a7e7-e319ea31c566 req-6ea80d97-5764-428e-ab63-194d4fdf285e service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:14.100404 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-923692c0-2b28-4b3e-a7e7-e319ea31c566 req-6ea80d97-5764-428e-ab63-194d4fdf285e service nova] Creating event network-changed:1a4e76f2-89b4-4926-8f9f-55d7fbf2ba35 for instance 1b342a18-835a-4975-99f6-8d47fb38676a on hv-cinder-85083 Jul 25 05:47:14.118509 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-923692c0-2b28-4b3e-a7e7-e319ea31c566 req-6ea80d97-5764-428e-ab63-194d4fdf285e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074105 Jul 25 05:47:14.126912 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 482/950] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:47:14.135975 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4da92964-74f8-46a6-82f8-afa1476f8e22 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:47:14.253492 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-46c2a610-4fb6-4687-bd3d-376568eb4a3a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:14.254152 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-46c2a610-4fb6-4687-bd3d-376568eb4a3a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:14.281694 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46c2a610-4fb6-4687-bd3d-376568eb4a3a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:14.282149 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46c2a610-4fb6-4687-bd3d-376568eb4a3a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:14.289882 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46c2a610-4fb6-4687-bd3d-376568eb4a3a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:14.296881 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46c2a610-4fb6-4687-bd3d-376568eb4a3a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:14.298860 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4da92964-74f8-46a6-82f8-afa1476f8e22 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 204 len: 0 microversion: 2.1 time: 0.263782 Jul 25 05:47:14.304166 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 469/951] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:47:14 2022] DELETE /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:47:14.316575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b45057e4-8108-41f8-b2c5-84a6874b6d96 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:14.318482 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b45057e4-8108-41f8-b2c5-84a6874b6d96 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:14.327263 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b45057e4-8108-41f8-b2c5-84a6874b6d96 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:14.327997 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b45057e4-8108-41f8-b2c5-84a6874b6d96 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:14.328992 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b45057e4-8108-41f8-b2c5-84a6874b6d96 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:14.329589 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b45057e4-8108-41f8-b2c5-84a6874b6d96 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:14.590027 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b45057e4-8108-41f8-b2c5-84a6874b6d96 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:14.598479 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b45057e4-8108-41f8-b2c5-84a6874b6d96 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1578 microversion: 2.1 time: 0.292512 Jul 25 05:47:14.610020 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 470/952] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:14 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1578 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:14.626753 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-46c2a610-4fb6-4687-bd3d-376568eb4a3a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:14.636584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-46c2a610-4fb6-4687-bd3d-376568eb4a3a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:14.638950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-46c2a610-4fb6-4687-bd3d-376568eb4a3a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:14.641361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-46c2a610-4fb6-4687-bd3d-376568eb4a3a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1739 microversion: 2.20 time: 0.393303 Jul 25 05:47:14.652629 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 483/953] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:14 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1739 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:47:15.620036 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-675ace57-c96e-4c87-86c8-9f28a486cc0c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:15.620679 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-675ace57-c96e-4c87-86c8-9f28a486cc0c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:15.628039 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-675ace57-c96e-4c87-86c8-9f28a486cc0c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:15.628502 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-675ace57-c96e-4c87-86c8-9f28a486cc0c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:15.630167 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-675ace57-c96e-4c87-86c8-9f28a486cc0c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:15.630671 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-675ace57-c96e-4c87-86c8-9f28a486cc0c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:15.662148 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-436ee84e-e7f3-44d5-8778-62e608c29c5b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:15.664341 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-436ee84e-e7f3-44d5-8778-62e608c29c5b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:15.671632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-436ee84e-e7f3-44d5-8778-62e608c29c5b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:15.672801 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-436ee84e-e7f3-44d5-8778-62e608c29c5b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:15.674070 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-436ee84e-e7f3-44d5-8778-62e608c29c5b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:15.674682 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-436ee84e-e7f3-44d5-8778-62e608c29c5b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:15.885539 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-436ee84e-e7f3-44d5-8778-62e608c29c5b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:15.895492 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-436ee84e-e7f3-44d5-8778-62e608c29c5b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:15.897278 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-436ee84e-e7f3-44d5-8778-62e608c29c5b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:15.898576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-436ee84e-e7f3-44d5-8778-62e608c29c5b tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1739 microversion: 2.20 time: 0.241640 Jul 25 05:47:15.911950 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 484/954] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:15 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:47:15.920744 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-675ace57-c96e-4c87-86c8-9f28a486cc0c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:15.929449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-675ace57-c96e-4c87-86c8-9f28a486cc0c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1578 microversion: 2.1 time: 0.315373 Jul 25 05:47:15.930383 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 471/955] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:15 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1578 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:16.920658 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7f945189-4232-4e1e-bf33-d37de61d4a9d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:16.922012 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7f945189-4232-4e1e-bf33-d37de61d4a9d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:16.930758 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f945189-4232-4e1e-bf33-d37de61d4a9d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:16.931828 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f945189-4232-4e1e-bf33-d37de61d4a9d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:16.932295 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f945189-4232-4e1e-bf33-d37de61d4a9d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:16.932832 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f945189-4232-4e1e-bf33-d37de61d4a9d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:16.948427 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d181b57a-6f2a-4993-9144-807d99a135b7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:16.950362 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d181b57a-6f2a-4993-9144-807d99a135b7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:16.968653 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d181b57a-6f2a-4993-9144-807d99a135b7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:16.969341 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d181b57a-6f2a-4993-9144-807d99a135b7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:16.970475 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d181b57a-6f2a-4993-9144-807d99a135b7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:16.971484 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d181b57a-6f2a-4993-9144-807d99a135b7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:17.102926 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d181b57a-6f2a-4993-9144-807d99a135b7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:17.111062 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d181b57a-6f2a-4993-9144-807d99a135b7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 200 len: 1392 microversion: 2.1 time: 0.167464 Jul 25 05:47:17.111646 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 472/956] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:16 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:47:17.117000 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-1f8a04af-5fc3-40cd-851e-8752a9e9278d req-f1d327ea-6b62-4735-ba4b-3a6e9e4736fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b342a18-835a-4975-99f6-8d47fb38676a", "name": "network-vif-deleted", "tag": "1a4e76f2-89b4-4926-8f9f-55d7fbf2ba35"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:47:17.126198 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-1f8a04af-5fc3-40cd-851e-8752a9e9278d req-f1d327ea-6b62-4735-ba4b-3a6e9e4736fc service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:17.126752 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-1f8a04af-5fc3-40cd-851e-8752a9e9278d req-f1d327ea-6b62-4735-ba4b-3a6e9e4736fc service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:17.143085 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-1f8a04af-5fc3-40cd-851e-8752a9e9278d req-f1d327ea-6b62-4735-ba4b-3a6e9e4736fc service nova] Creating event network-vif-deleted:1a4e76f2-89b4-4926-8f9f-55d7fbf2ba35 for instance 1b342a18-835a-4975-99f6-8d47fb38676a on hv-cinder-85083 Jul 25 05:47:17.148450 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-1f8a04af-5fc3-40cd-851e-8752a9e9278d req-f1d327ea-6b62-4735-ba4b-3a6e9e4736fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035601 Jul 25 05:47:17.151962 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 473/957] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:47:17.174556 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7f945189-4232-4e1e-bf33-d37de61d4a9d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:17.189659 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7f945189-4232-4e1e-bf33-d37de61d4a9d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:17.192316 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7f945189-4232-4e1e-bf33-d37de61d4a9d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:17.195061 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7f945189-4232-4e1e-bf33-d37de61d4a9d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1739 microversion: 2.20 time: 0.279555 Jul 25 05:47:17.195944 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 485/958] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:16 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1739 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:18.129834 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5664c437-b637-45fe-88ec-0d588ccc421a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:18.130694 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5664c437-b637-45fe-88ec-0d588ccc421a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: 1b342a18-835a-4975-99f6-8d47fb38676a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:18.137659 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5664c437-b637-45fe-88ec-0d588ccc421a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:18.138115 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5664c437-b637-45fe-88ec-0d588ccc421a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:18.138887 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5664c437-b637-45fe-88ec-0d588ccc421a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:18.139368 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5664c437-b637-45fe-88ec-0d588ccc421a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:18.143560 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:18.153651 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-5664c437-b637-45fe-88ec-0d588ccc421a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] HTTP exception thrown: Instance 1b342a18-835a-4975-99f6-8d47fb38676a could not be found. Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5664c437-b637-45fe-88ec-0d588ccc421a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Request method failure captured: Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a HTTP/1.1 Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iyM4iy7GPDLw_QaccoyiJV3b9PTWi1SldICPEtIzdbJYVB6XUnRKwbQ7T9i8_E2IJ_enYBppSBNkSNwVziotGPoqZQ5WHqiFZw4uMU3oUrr_w_9_KjBd2iPMtOFAY5RBp0QHK-fMVvRKr0oZH5_kxx6rJgIHSz44B8nL64lnA31fcY Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: ee638472255a48d2bdffa17a4ff22339 Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:47:18.155385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ee638472255a48d2bdffa17a4ff22339"}]}] Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: ee638472255a48d2bdffa17a4ff22339 Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-TestVolumeBootPattern-301894717-project Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 1f815f111bf74739969736acea131927 Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-TestVolumeBootPattern-301894717-project Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 1b342a18-835a-4975-99f6-8d47fb38676a could not be found. Jul 25 05:47:18.157108 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '1b342a18-835a-4975-99f6-8d47fb38676a'} Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b342a18-835a-4975-99f6-8d47fb38676a could not be found. Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:47:18.158029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b342a18-835a-4975-99f6-8d47fb38676a could not be found. Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b342a18-835a-4975-99f6-8d47fb38676a could not be found. Jul 25 05:47:18.159378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:18.160913 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5664c437-b637-45fe-88ec-0d588ccc421a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Returning 404 to user: Instance 1b342a18-835a-4975-99f6-8d47fb38676a could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:47:18.160913 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5664c437-b637-45fe-88ec-0d588ccc421a tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a" status: 404 len: 111 microversion: 2.1 time: 0.031860 Jul 25 05:47:18.160913 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 474/959] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:18 2022] GET /compute/v2.1/servers/1b342a18-835a-4975-99f6-8d47fb38676a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:47:18.213616 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-db513bb6-98c3-42b7-b079-1084a9e37324 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:18.214232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-db513bb6-98c3-42b7-b079-1084a9e37324 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:18.221100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-db513bb6-98c3-42b7-b079-1084a9e37324 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:18.221535 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-db513bb6-98c3-42b7-b079-1084a9e37324 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:18.222312 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-db513bb6-98c3-42b7-b079-1084a9e37324 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:18.222755 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-db513bb6-98c3-42b7-b079-1084a9e37324 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:18.353889 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-db513bb6-98c3-42b7-b079-1084a9e37324 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:18.362148 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-db513bb6-98c3-42b7-b079-1084a9e37324 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:18.363670 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-db513bb6-98c3-42b7-b079-1084a9e37324 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:18.364898 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-db513bb6-98c3-42b7-b079-1084a9e37324 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1739 microversion: 2.20 time: 0.155268 Jul 25 05:47:18.365459 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 486/960] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:18 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:19.383284 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c5241eeb-513f-482d-be2d-09c6b19c5db0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:19.383899 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c5241eeb-513f-482d-be2d-09c6b19c5db0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:19.391689 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5241eeb-513f-482d-be2d-09c6b19c5db0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:19.392143 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5241eeb-513f-482d-be2d-09c6b19c5db0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:19.392940 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5241eeb-513f-482d-be2d-09c6b19c5db0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:19.393387 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5241eeb-513f-482d-be2d-09c6b19c5db0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:19.531983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c5241eeb-513f-482d-be2d-09c6b19c5db0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:19.540690 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c5241eeb-513f-482d-be2d-09c6b19c5db0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:19.542646 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c5241eeb-513f-482d-be2d-09c6b19c5db0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:19.543823 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c5241eeb-513f-482d-be2d-09c6b19c5db0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1721 microversion: 2.20 time: 0.164500 Jul 25 05:47:19.544376 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 475/961] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:19 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:20.026889 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-a678d190-2e79-493a-84fc-a1bf0484a884 req-52956420-17f0-4dc8-bb56-57c595a6bdf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd734fd-ed06-4c5b-828a-e812b5ddec59", "name": "network-vif-unplugged", "status": "completed", "tag": "07fab7eb-0b40-4f15-aaa2-f8ee69446342"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:47:20.036040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-a678d190-2e79-493a-84fc-a1bf0484a884 req-52956420-17f0-4dc8-bb56-57c595a6bdf8 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:20.036765 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-a678d190-2e79-493a-84fc-a1bf0484a884 req-52956420-17f0-4dc8-bb56-57c595a6bdf8 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:20.048359 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-a678d190-2e79-493a-84fc-a1bf0484a884 req-52956420-17f0-4dc8-bb56-57c595a6bdf8 service nova] Creating event network-vif-unplugged:07fab7eb-0b40-4f15-aaa2-f8ee69446342 for instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 on hv-cinder-85083 Jul 25 05:47:20.053335 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-a678d190-2e79-493a-84fc-a1bf0484a884 req-52956420-17f0-4dc8-bb56-57c595a6bdf8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030793 Jul 25 05:47:20.053919 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 487/962] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:47:20.562126 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9c7db352-c8e0-4649-8494-20a20f36ce2e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:20.562742 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9c7db352-c8e0-4649-8494-20a20f36ce2e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:20.569243 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c7db352-c8e0-4649-8494-20a20f36ce2e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:20.569715 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c7db352-c8e0-4649-8494-20a20f36ce2e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:20.571120 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c7db352-c8e0-4649-8494-20a20f36ce2e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:20.571631 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9c7db352-c8e0-4649-8494-20a20f36ce2e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:21.035846 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9c7db352-c8e0-4649-8494-20a20f36ce2e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:21.044260 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9c7db352-c8e0-4649-8494-20a20f36ce2e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:21.045799 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9c7db352-c8e0-4649-8494-20a20f36ce2e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:21.047018 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9c7db352-c8e0-4649-8494-20a20f36ce2e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1721 microversion: 2.20 time: 0.488806 Jul 25 05:47:21.047569 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 476/963] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:20 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1721 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:21.573201 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-49ae275a-0e4e-4dd2-a2a9-3720de265881 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:21.573805 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-49ae275a-0e4e-4dd2-a2a9-3720de265881 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:21.574418 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-b62dfd9f-197d-489e-98cb-669da389e434 req-cce0ddc7-e81f-4e4a-b938-0f94ba196c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc622d78-aba1-429a-8fe6-b3b0252bc63e", "tag": "b0866f27-ba8f-4546-9f9a-870e1b130663"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:47:21.581759 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49ae275a-0e4e-4dd2-a2a9-3720de265881 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:21.582217 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49ae275a-0e4e-4dd2-a2a9-3720de265881 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:21.582993 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49ae275a-0e4e-4dd2-a2a9-3720de265881 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:21.583365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b62dfd9f-197d-489e-98cb-669da389e434 req-cce0ddc7-e81f-4e4a-b938-0f94ba196c4f service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:21.583622 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-49ae275a-0e4e-4dd2-a2a9-3720de265881 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:21.583995 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b62dfd9f-197d-489e-98cb-669da389e434 req-cce0ddc7-e81f-4e4a-b938-0f94ba196c4f service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:21.595821 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-b62dfd9f-197d-489e-98cb-669da389e434 req-cce0ddc7-e81f-4e4a-b938-0f94ba196c4f service nova] Creating event network-changed:b0866f27-ba8f-4546-9f9a-870e1b130663 for instance bc622d78-aba1-429a-8fe6-b3b0252bc63e on hv-cinder-85083 Jul 25 05:47:21.601306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-b62dfd9f-197d-489e-98cb-669da389e434 req-cce0ddc7-e81f-4e4a-b938-0f94ba196c4f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031247 Jul 25 05:47:21.602343 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 477/964] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:47:21.611722 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-49ae275a-0e4e-4dd2-a2a9-3720de265881 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Going to try to terminate instance {{(pid=124467) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:47:21.662518 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:21.696169 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-49ae275a-0e4e-4dd2-a2a9-3720de265881 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 204 len: 0 microversion: 2.1 time: 0.127795 Jul 25 05:47:21.697060 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 488/965] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:47:21 2022] DELETE /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:47:21.706142 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-40fab555-c09a-420a-8bf0-ab3487416572 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:21.706873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-40fab555-c09a-420a-8bf0-ab3487416572 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:21.713359 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40fab555-c09a-420a-8bf0-ab3487416572 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:21.713822 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40fab555-c09a-420a-8bf0-ab3487416572 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:21.714602 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40fab555-c09a-420a-8bf0-ab3487416572 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:21.715051 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40fab555-c09a-420a-8bf0-ab3487416572 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:21.854526 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-40fab555-c09a-420a-8bf0-ab3487416572 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:21.863206 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-40fab555-c09a-420a-8bf0-ab3487416572 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1579 microversion: 2.1 time: 0.161485 Jul 25 05:47:21.863782 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 478/966] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:21 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:22.066013 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8142529f-d7f0-482a-9ca2-cda92c000c61 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:22.066658 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8142529f-d7f0-482a-9ca2-cda92c000c61 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:22.073232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8142529f-d7f0-482a-9ca2-cda92c000c61 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:22.073683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8142529f-d7f0-482a-9ca2-cda92c000c61 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:22.074440 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8142529f-d7f0-482a-9ca2-cda92c000c61 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:22.074879 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8142529f-d7f0-482a-9ca2-cda92c000c61 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:22.209814 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8142529f-d7f0-482a-9ca2-cda92c000c61 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:22.218556 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8142529f-d7f0-482a-9ca2-cda92c000c61 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:22.220084 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8142529f-d7f0-482a-9ca2-cda92c000c61 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:22.221298 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8142529f-d7f0-482a-9ca2-cda92c000c61 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1664 microversion: 2.20 time: 0.159599 Jul 25 05:47:22.221853 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 489/967] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:22 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:22.240061 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3ac2c180-a26e-4bab-92c9-e46e33ee6672 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e266022-b1f8-46fb-923a-32ea1cf8c1bb"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:47:22.241170 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3ac2c180-a26e-4bab-92c9-e46e33ee6672 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:22.248049 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ac2c180-a26e-4bab-92c9-e46e33ee6672 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:22.248498 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ac2c180-a26e-4bab-92c9-e46e33ee6672 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:22.249289 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ac2c180-a26e-4bab-92c9-e46e33ee6672 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:22.249728 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ac2c180-a26e-4bab-92c9-e46e33ee6672 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:22.527172 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3ac2c180-a26e-4bab-92c9-e46e33ee6672 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "POST /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291068 Jul 25 05:47:22.527904 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 479/968] 10.222.0.33 () {62 vars in 1363 bytes} [Mon Jul 25 05:47:22 2022] POST /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:47:22.645238 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-bdb92c76-c6d3-404a-ac43-fb047859749d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:22.645762 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-bdb92c76-c6d3-404a-ac43-fb047859749d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:22.648078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:22.653413 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bdb92c76-c6d3-404a-ac43-fb047859749d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:22.653858 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bdb92c76-c6d3-404a-ac43-fb047859749d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:22.654612 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bdb92c76-c6d3-404a-ac43-fb047859749d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:22.655045 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-bdb92c76-c6d3-404a-ac43-fb047859749d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:22.880571 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1fa14fbc-bfc0-4218-a362-4c5db80aea03 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:22.881302 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1fa14fbc-bfc0-4218-a362-4c5db80aea03 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:22.889313 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1fa14fbc-bfc0-4218-a362-4c5db80aea03 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:22.889832 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1fa14fbc-bfc0-4218-a362-4c5db80aea03 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:22.890618 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1fa14fbc-bfc0-4218-a362-4c5db80aea03 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:22.891074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1fa14fbc-bfc0-4218-a362-4c5db80aea03 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:22.902171 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-bdb92c76-c6d3-404a-ac43-fb047859749d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/os-volume_attachments/7e266022-b1f8-46fb-923a-32ea1cf8c1bb" status: 202 len: 0 microversion: 2.20 time: 0.260669 Jul 25 05:47:22.905970 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 490/969] 10.222.0.33 () {60 vars in 1456 bytes} [Mon Jul 25 05:47:22 2022] DELETE /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/os-volume_attachments/7e266022-b1f8-46fb-923a-32ea1cf8c1bb => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:47:22.961708 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a4b31212-f1bf-47ea-a16f-e570ff450d5a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:47:22.962354 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a4b31212-f1bf-47ea-a16f-e570ff450d5a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:22.968879 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a4b31212-f1bf-47ea-a16f-e570ff450d5a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:22.969325 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a4b31212-f1bf-47ea-a16f-e570ff450d5a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:22.970082 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a4b31212-f1bf-47ea-a16f-e570ff450d5a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:22.970515 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a4b31212-f1bf-47ea-a16f-e570ff450d5a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:23.036178 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1fa14fbc-bfc0-4218-a362-4c5db80aea03 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:23.044422 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1fa14fbc-bfc0-4218-a362-4c5db80aea03 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1579 microversion: 2.1 time: 0.167699 Jul 25 05:47:23.045037 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 480/970] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:22 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:47:23.063501 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a4b31212-f1bf-47ea-a16f-e570ff450d5a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "POST /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/action" status: 202 len: 0 microversion: 2.20 time: 0.106406 Jul 25 05:47:23.064100 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 491/971] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jul 25 05:47:22 2022] POST /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 05:47:23.072335 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cc42ad03-1cc5-4cd7-8be4-6f5bc41c75e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:23.072974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cc42ad03-1cc5-4cd7-8be4-6f5bc41c75e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:23.085217 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc42ad03-1cc5-4cd7-8be4-6f5bc41c75e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:23.085674 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc42ad03-1cc5-4cd7-8be4-6f5bc41c75e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:23.087169 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc42ad03-1cc5-4cd7-8be4-6f5bc41c75e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:23.087607 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc42ad03-1cc5-4cd7-8be4-6f5bc41c75e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:23.226611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cc42ad03-1cc5-4cd7-8be4-6f5bc41c75e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:23.236180 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cc42ad03-1cc5-4cd7-8be4-6f5bc41c75e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:23.238697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cc42ad03-1cc5-4cd7-8be4-6f5bc41c75e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:23.239857 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cc42ad03-1cc5-4cd7-8be4-6f5bc41c75e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1672 microversion: 2.20 time: 0.171704 Jul 25 05:47:23.240403 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 481/972] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:23 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:24.062593 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a284e918-5905-409a-b0a4-142433764a73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:24.063218 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a284e918-5905-409a-b0a4-142433764a73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:24.069612 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a284e918-5905-409a-b0a4-142433764a73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:24.070094 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a284e918-5905-409a-b0a4-142433764a73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:24.071148 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a284e918-5905-409a-b0a4-142433764a73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:24.071563 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a284e918-5905-409a-b0a4-142433764a73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:24.207652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a284e918-5905-409a-b0a4-142433764a73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:24.215910 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a284e918-5905-409a-b0a4-142433764a73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1579 microversion: 2.1 time: 0.157996 Jul 25 05:47:24.216561 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 492/973] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:24 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:24.259507 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ced70a0b-7dd8-41b7-bfa7-c31406fe919f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:24.260307 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ced70a0b-7dd8-41b7-bfa7-c31406fe919f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:24.266954 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ced70a0b-7dd8-41b7-bfa7-c31406fe919f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:24.267503 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ced70a0b-7dd8-41b7-bfa7-c31406fe919f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:24.268451 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ced70a0b-7dd8-41b7-bfa7-c31406fe919f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:24.268994 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ced70a0b-7dd8-41b7-bfa7-c31406fe919f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:24.400308 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ced70a0b-7dd8-41b7-bfa7-c31406fe919f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:24.408301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ced70a0b-7dd8-41b7-bfa7-c31406fe919f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:24.409881 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ced70a0b-7dd8-41b7-bfa7-c31406fe919f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:24.411078 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ced70a0b-7dd8-41b7-bfa7-c31406fe919f tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.156125 Jul 25 05:47:24.411624 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 482/974] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:24 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:25.234186 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b788d51d-25e6-4d6a-b8ed-37b2e2f074c2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:25.234729 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b788d51d-25e6-4d6a-b8ed-37b2e2f074c2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:25.241184 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b788d51d-25e6-4d6a-b8ed-37b2e2f074c2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:25.241644 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b788d51d-25e6-4d6a-b8ed-37b2e2f074c2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:25.242534 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b788d51d-25e6-4d6a-b8ed-37b2e2f074c2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:25.243241 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b788d51d-25e6-4d6a-b8ed-37b2e2f074c2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:25.314170 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b788d51d-25e6-4d6a-b8ed-37b2e2f074c2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:25.321934 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b788d51d-25e6-4d6a-b8ed-37b2e2f074c2 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1393 microversion: 2.1 time: 0.092088 Jul 25 05:47:25.322602 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 493/975] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:25 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1393 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:25.365505 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-3ee2f870-21a3-4cb3-b90e-8c1a2feb4480 req-31508a02-b507-4902-9dc4-6bd3d44d67b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc622d78-aba1-429a-8fe6-b3b0252bc63e", "name": "network-vif-deleted", "tag": "b0866f27-ba8f-4546-9f9a-870e1b130663"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:47:25.372647 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:25.377176 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-3ee2f870-21a3-4cb3-b90e-8c1a2feb4480 req-31508a02-b507-4902-9dc4-6bd3d44d67b6 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:25.377693 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-3ee2f870-21a3-4cb3-b90e-8c1a2feb4480 req-31508a02-b507-4902-9dc4-6bd3d44d67b6 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:25.393530 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-3ee2f870-21a3-4cb3-b90e-8c1a2feb4480 req-31508a02-b507-4902-9dc4-6bd3d44d67b6 service nova] Creating event network-vif-deleted:b0866f27-ba8f-4546-9f9a-870e1b130663 for instance bc622d78-aba1-429a-8fe6-b3b0252bc63e on hv-cinder-85083 Jul 25 05:47:25.400521 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-3ee2f870-21a3-4cb3-b90e-8c1a2feb4480 req-31508a02-b507-4902-9dc4-6bd3d44d67b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040557 Jul 25 05:47:25.401147 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 483/976] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:47:25.428687 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-907b0516-609c-4442-a0fe-4055ca12c0f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:25.429351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-907b0516-609c-4442-a0fe-4055ca12c0f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:25.437205 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-907b0516-609c-4442-a0fe-4055ca12c0f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:25.437657 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-907b0516-609c-4442-a0fe-4055ca12c0f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:25.438428 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-907b0516-609c-4442-a0fe-4055ca12c0f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:25.438864 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-907b0516-609c-4442-a0fe-4055ca12c0f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:25.577689 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-907b0516-609c-4442-a0fe-4055ca12c0f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:25.587066 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-907b0516-609c-4442-a0fe-4055ca12c0f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:25.588639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-907b0516-609c-4442-a0fe-4055ca12c0f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:25.589886 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-907b0516-609c-4442-a0fe-4055ca12c0f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.165201 Jul 25 05:47:25.590439 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 494/977] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:25 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:26.340369 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9f94442b-794d-4264-8575-ea29197343f7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:26.341382 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9f94442b-794d-4264-8575-ea29197343f7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:26.348159 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f94442b-794d-4264-8575-ea29197343f7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:26.348997 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f94442b-794d-4264-8575-ea29197343f7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:26.350014 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f94442b-794d-4264-8575-ea29197343f7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:26.350682 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f94442b-794d-4264-8575-ea29197343f7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:26.388976 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f94442b-794d-4264-8575-ea29197343f7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:26.389978 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f94442b-794d-4264-8575-ea29197343f7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:26.390636 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-9f94442b-794d-4264-8575-ea29197343f7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lazy-loading 'fault' on Instance uuid bc622d78-aba1-429a-8fe6-b3b0252bc63e {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:47:26.438157 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9f94442b-794d-4264-8575-ea29197343f7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:26.446191 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9f94442b-794d-4264-8575-ea29197343f7 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1398 microversion: 2.1 time: 0.110382 Jul 25 05:47:26.446805 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 484/978] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:26 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1398 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:26.608326 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-dd0e50ad-4e26-4b9a-bc51-93c36c5f145c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:26.609243 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-dd0e50ad-4e26-4b9a-bc51-93c36c5f145c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:26.615888 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd0e50ad-4e26-4b9a-bc51-93c36c5f145c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:26.616333 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd0e50ad-4e26-4b9a-bc51-93c36c5f145c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:26.617121 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd0e50ad-4e26-4b9a-bc51-93c36c5f145c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:26.618135 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dd0e50ad-4e26-4b9a-bc51-93c36c5f145c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:26.771591 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-dd0e50ad-4e26-4b9a-bc51-93c36c5f145c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:26.780171 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-dd0e50ad-4e26-4b9a-bc51-93c36c5f145c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:26.781851 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-dd0e50ad-4e26-4b9a-bc51-93c36c5f145c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:26.783053 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-dd0e50ad-4e26-4b9a-bc51-93c36c5f145c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.178716 Jul 25 05:47:26.783604 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 495/979] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:26 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:27.464095 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f085ed8b-9912-4dc3-8fdf-79515078d685 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:27.465670 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f085ed8b-9912-4dc3-8fdf-79515078d685 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:27.472943 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f085ed8b-9912-4dc3-8fdf-79515078d685 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:27.473734 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f085ed8b-9912-4dc3-8fdf-79515078d685 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:27.474743 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f085ed8b-9912-4dc3-8fdf-79515078d685 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:27.475410 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f085ed8b-9912-4dc3-8fdf-79515078d685 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:27.512093 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f085ed8b-9912-4dc3-8fdf-79515078d685 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:27.512857 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f085ed8b-9912-4dc3-8fdf-79515078d685 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:27.513388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-f085ed8b-9912-4dc3-8fdf-79515078d685 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lazy-loading 'fault' on Instance uuid bc622d78-aba1-429a-8fe6-b3b0252bc63e {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:47:27.558807 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f085ed8b-9912-4dc3-8fdf-79515078d685 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:27.566810 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f085ed8b-9912-4dc3-8fdf-79515078d685 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1398 microversion: 2.1 time: 0.107070 Jul 25 05:47:27.567590 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 485/980] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:27 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1398 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:27.804042 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6ab82132-f06f-4af7-b4c5-79ee8ca134f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:27.805309 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-6ab82132-f06f-4af7-b4c5-79ee8ca134f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:27.813396 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6ab82132-f06f-4af7-b4c5-79ee8ca134f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:27.813873 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6ab82132-f06f-4af7-b4c5-79ee8ca134f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:27.814811 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6ab82132-f06f-4af7-b4c5-79ee8ca134f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:27.815584 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-6ab82132-f06f-4af7-b4c5-79ee8ca134f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:27.972347 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6ab82132-f06f-4af7-b4c5-79ee8ca134f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:27.981416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6ab82132-f06f-4af7-b4c5-79ee8ca134f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:27.983247 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-6ab82132-f06f-4af7-b4c5-79ee8ca134f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:27.984964 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6ab82132-f06f-4af7-b4c5-79ee8ca134f3 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.186193 Jul 25 05:47:27.996445 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 496/981] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:27 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:28.593036 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-11c10649-6a74-4636-acbe-20521417ed5b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:28.593953 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-11c10649-6a74-4636-acbe-20521417ed5b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:28.600534 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11c10649-6a74-4636-acbe-20521417ed5b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:28.601035 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11c10649-6a74-4636-acbe-20521417ed5b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:28.602411 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11c10649-6a74-4636-acbe-20521417ed5b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:28.602857 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11c10649-6a74-4636-acbe-20521417ed5b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:28.635349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11c10649-6a74-4636-acbe-20521417ed5b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:28.635912 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11c10649-6a74-4636-acbe-20521417ed5b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:28.636370 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-11c10649-6a74-4636-acbe-20521417ed5b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lazy-loading 'fault' on Instance uuid bc622d78-aba1-429a-8fe6-b3b0252bc63e {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:47:28.681252 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-11c10649-6a74-4636-acbe-20521417ed5b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:28.689505 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-11c10649-6a74-4636-acbe-20521417ed5b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1398 microversion: 2.1 time: 0.100689 Jul 25 05:47:28.690092 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 486/982] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:28 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1398 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:29.004241 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-598a4bf9-e6d4-4efc-8ff4-1a39a3e834e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:29.005644 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-598a4bf9-e6d4-4efc-8ff4-1a39a3e834e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:29.014286 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-598a4bf9-e6d4-4efc-8ff4-1a39a3e834e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:29.015109 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-598a4bf9-e6d4-4efc-8ff4-1a39a3e834e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:29.016122 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-598a4bf9-e6d4-4efc-8ff4-1a39a3e834e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:29.016816 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-598a4bf9-e6d4-4efc-8ff4-1a39a3e834e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:29.159697 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-598a4bf9-e6d4-4efc-8ff4-1a39a3e834e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:29.169128 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-598a4bf9-e6d4-4efc-8ff4-1a39a3e834e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:29.171238 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-598a4bf9-e6d4-4efc-8ff4-1a39a3e834e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:29.172732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-598a4bf9-e6d4-4efc-8ff4-1a39a3e834e0 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.173103 Jul 25 05:47:29.174025 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 497/983] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:28 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:29.708148 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7987a224-92cb-464b-93e2-7b19502a8bef tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:29.709657 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7987a224-92cb-464b-93e2-7b19502a8bef tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:29.720398 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7987a224-92cb-464b-93e2-7b19502a8bef tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:29.720984 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7987a224-92cb-464b-93e2-7b19502a8bef tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:29.721823 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7987a224-92cb-464b-93e2-7b19502a8bef tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:29.722382 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7987a224-92cb-464b-93e2-7b19502a8bef tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:29.757515 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7987a224-92cb-464b-93e2-7b19502a8bef tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:29.758639 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7987a224-92cb-464b-93e2-7b19502a8bef tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:29.759164 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-7987a224-92cb-464b-93e2-7b19502a8bef tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lazy-loading 'fault' on Instance uuid bc622d78-aba1-429a-8fe6-b3b0252bc63e {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:47:29.812489 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7987a224-92cb-464b-93e2-7b19502a8bef tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:29.820282 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7987a224-92cb-464b-93e2-7b19502a8bef tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1398 microversion: 2.1 time: 0.117136 Jul 25 05:47:29.821445 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 487/984] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:29 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1398 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:30.191639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cc046c2c-4fec-4e70-a01b-b00d786c0064 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:30.192948 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-cc046c2c-4fec-4e70-a01b-b00d786c0064 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:30.200526 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cc046c2c-4fec-4e70-a01b-b00d786c0064 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:30.201271 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cc046c2c-4fec-4e70-a01b-b00d786c0064 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:30.202222 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cc046c2c-4fec-4e70-a01b-b00d786c0064 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:30.202822 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cc046c2c-4fec-4e70-a01b-b00d786c0064 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:30.341903 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cc046c2c-4fec-4e70-a01b-b00d786c0064 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:30.350604 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cc046c2c-4fec-4e70-a01b-b00d786c0064 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:30.352287 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cc046c2c-4fec-4e70-a01b-b00d786c0064 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:30.353729 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cc046c2c-4fec-4e70-a01b-b00d786c0064 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.165923 Jul 25 05:47:30.354689 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 498/985] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:30 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:30.839506 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-aaf726d0-f4a2-4411-a563-2d85f7acca1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:30.840864 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-aaf726d0-f4a2-4411-a563-2d85f7acca1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:30.848083 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aaf726d0-f4a2-4411-a563-2d85f7acca1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:30.848543 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aaf726d0-f4a2-4411-a563-2d85f7acca1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:30.849823 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aaf726d0-f4a2-4411-a563-2d85f7acca1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:30.850276 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aaf726d0-f4a2-4411-a563-2d85f7acca1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:30.884896 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aaf726d0-f4a2-4411-a563-2d85f7acca1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:30.885358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aaf726d0-f4a2-4411-a563-2d85f7acca1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:30.885812 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-aaf726d0-f4a2-4411-a563-2d85f7acca1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lazy-loading 'fault' on Instance uuid bc622d78-aba1-429a-8fe6-b3b0252bc63e {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:47:30.888616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:30.940931 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aaf726d0-f4a2-4411-a563-2d85f7acca1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:30.950662 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-aaf726d0-f4a2-4411-a563-2d85f7acca1f tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1398 microversion: 2.1 time: 0.114614 Jul 25 05:47:30.960202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 488/986] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:30 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1398 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:31.373091 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-cdb760c4-c501-4821-b3b6-41eccf578cef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:31.373866 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-cdb760c4-c501-4821-b3b6-41eccf578cef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:31.380507 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cdb760c4-c501-4821-b3b6-41eccf578cef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:31.380991 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cdb760c4-c501-4821-b3b6-41eccf578cef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:31.381768 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cdb760c4-c501-4821-b3b6-41eccf578cef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:31.382459 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-cdb760c4-c501-4821-b3b6-41eccf578cef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:31.527214 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cdb760c4-c501-4821-b3b6-41eccf578cef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:31.538142 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cdb760c4-c501-4821-b3b6-41eccf578cef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:31.540014 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-cdb760c4-c501-4821-b3b6-41eccf578cef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:31.541250 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-cdb760c4-c501-4821-b3b6-41eccf578cef tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.172105 Jul 25 05:47:31.541818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 499/987] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:31 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:31.968149 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e944e6b5-3a6a-4158-8a7e-14565f0c6d11 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:31.968869 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e944e6b5-3a6a-4158-8a7e-14565f0c6d11 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:31.975580 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e944e6b5-3a6a-4158-8a7e-14565f0c6d11 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:31.976039 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e944e6b5-3a6a-4158-8a7e-14565f0c6d11 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:31.977548 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e944e6b5-3a6a-4158-8a7e-14565f0c6d11 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:31.978321 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e944e6b5-3a6a-4158-8a7e-14565f0c6d11 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:32.011762 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e944e6b5-3a6a-4158-8a7e-14565f0c6d11 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:32.012213 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e944e6b5-3a6a-4158-8a7e-14565f0c6d11 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:32.012666 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-e944e6b5-3a6a-4158-8a7e-14565f0c6d11 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lazy-loading 'fault' on Instance uuid bc622d78-aba1-429a-8fe6-b3b0252bc63e {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:47:32.055657 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e944e6b5-3a6a-4158-8a7e-14565f0c6d11 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:32.063378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e944e6b5-3a6a-4158-8a7e-14565f0c6d11 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1398 microversion: 2.1 time: 0.099217 Jul 25 05:47:32.063885 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 489/988] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:31 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1398 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:32.559653 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5b841dae-5ad7-4ddb-8390-3972b121228a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:32.560370 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5b841dae-5ad7-4ddb-8390-3972b121228a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:32.566975 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b841dae-5ad7-4ddb-8390-3972b121228a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:32.567425 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b841dae-5ad7-4ddb-8390-3972b121228a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:32.568180 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b841dae-5ad7-4ddb-8390-3972b121228a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:32.568618 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5b841dae-5ad7-4ddb-8390-3972b121228a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:32.707567 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5b841dae-5ad7-4ddb-8390-3972b121228a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:32.717594 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5b841dae-5ad7-4ddb-8390-3972b121228a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:32.719243 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5b841dae-5ad7-4ddb-8390-3972b121228a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:32.720505 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5b841dae-5ad7-4ddb-8390-3972b121228a tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.164924 Jul 25 05:47:32.721209 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 500/989] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:32 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:33.081647 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-88ec6223-8e24-4d07-a4c9-ebca666f1a8c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:33.083381 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-88ec6223-8e24-4d07-a4c9-ebca666f1a8c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:33.091497 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88ec6223-8e24-4d07-a4c9-ebca666f1a8c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:33.091953 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88ec6223-8e24-4d07-a4c9-ebca666f1a8c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:33.092792 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88ec6223-8e24-4d07-a4c9-ebca666f1a8c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:33.093385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88ec6223-8e24-4d07-a4c9-ebca666f1a8c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:33.125665 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88ec6223-8e24-4d07-a4c9-ebca666f1a8c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:33.126124 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88ec6223-8e24-4d07-a4c9-ebca666f1a8c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:33.126586 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-88ec6223-8e24-4d07-a4c9-ebca666f1a8c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lazy-loading 'fault' on Instance uuid bc622d78-aba1-429a-8fe6-b3b0252bc63e {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:47:33.169557 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-88ec6223-8e24-4d07-a4c9-ebca666f1a8c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:33.177839 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-88ec6223-8e24-4d07-a4c9-ebca666f1a8c tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1398 microversion: 2.1 time: 0.100641 Jul 25 05:47:33.178758 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 490/990] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:33 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1398 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:33.739959 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-74104c52-e588-48ab-8c9c-e3b9986da49c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:33.740694 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-74104c52-e588-48ab-8c9c-e3b9986da49c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:33.749415 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-74104c52-e588-48ab-8c9c-e3b9986da49c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:33.749803 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-74104c52-e588-48ab-8c9c-e3b9986da49c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:33.750722 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-74104c52-e588-48ab-8c9c-e3b9986da49c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:33.751170 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-74104c52-e588-48ab-8c9c-e3b9986da49c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:33.890102 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-74104c52-e588-48ab-8c9c-e3b9986da49c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:33.892360 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:33.900256 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-74104c52-e588-48ab-8c9c-e3b9986da49c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:33.901820 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-74104c52-e588-48ab-8c9c-e3b9986da49c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:33.903015 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-74104c52-e588-48ab-8c9c-e3b9986da49c tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.167840 Jul 25 05:47:33.903574 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 501/991] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:33 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:34.195050 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-28f79e3a-c420-403d-8f9a-35a922b0162b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:34.195662 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-28f79e3a-c420-403d-8f9a-35a922b0162b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:34.202600 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28f79e3a-c420-403d-8f9a-35a922b0162b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:34.203053 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28f79e3a-c420-403d-8f9a-35a922b0162b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:34.203814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28f79e3a-c420-403d-8f9a-35a922b0162b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:34.204250 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28f79e3a-c420-403d-8f9a-35a922b0162b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:34.235191 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28f79e3a-c420-403d-8f9a-35a922b0162b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:34.235636 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28f79e3a-c420-403d-8f9a-35a922b0162b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:34.236087 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-28f79e3a-c420-403d-8f9a-35a922b0162b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lazy-loading 'fault' on Instance uuid bc622d78-aba1-429a-8fe6-b3b0252bc63e {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:47:34.280812 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-28f79e3a-c420-403d-8f9a-35a922b0162b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:34.288163 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-28f79e3a-c420-403d-8f9a-35a922b0162b tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1398 microversion: 2.1 time: 0.096940 Jul 25 05:47:34.288715 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 491/992] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:34 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1398 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:34.922168 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-92c31247-99ae-4b94-badb-b394b3c38c27 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:34.922810 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-92c31247-99ae-4b94-badb-b394b3c38c27 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:34.930964 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92c31247-99ae-4b94-badb-b394b3c38c27 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:34.931436 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92c31247-99ae-4b94-badb-b394b3c38c27 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:34.932180 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92c31247-99ae-4b94-badb-b394b3c38c27 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:34.932620 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-92c31247-99ae-4b94-badb-b394b3c38c27 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:35.062917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-92c31247-99ae-4b94-badb-b394b3c38c27 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:35.070826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-92c31247-99ae-4b94-badb-b394b3c38c27 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:35.072594 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-92c31247-99ae-4b94-badb-b394b3c38c27 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:35.073792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-92c31247-99ae-4b94-badb-b394b3c38c27 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.155891 Jul 25 05:47:35.074359 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 502/993] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:34 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:35.306082 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6a8d106a-728f-49cd-87e5-cede83a22fb6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:35.306733 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6a8d106a-728f-49cd-87e5-cede83a22fb6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:35.313207 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a8d106a-728f-49cd-87e5-cede83a22fb6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:35.313670 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a8d106a-728f-49cd-87e5-cede83a22fb6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:35.314438 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a8d106a-728f-49cd-87e5-cede83a22fb6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:35.314882 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a8d106a-728f-49cd-87e5-cede83a22fb6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:35.346483 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a8d106a-728f-49cd-87e5-cede83a22fb6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:35.346999 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a8d106a-728f-49cd-87e5-cede83a22fb6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:35.347453 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-6a8d106a-728f-49cd-87e5-cede83a22fb6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lazy-loading 'fault' on Instance uuid bc622d78-aba1-429a-8fe6-b3b0252bc63e {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:47:35.389365 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6a8d106a-728f-49cd-87e5-cede83a22fb6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f815f111bf74739969736acea131927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638472255a48d2bdffa17a4ff22339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:35.396824 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6a8d106a-728f-49cd-87e5-cede83a22fb6 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 200 len: 1398 microversion: 2.1 time: 0.095213 Jul 25 05:47:35.397400 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 492/994] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:35 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 1398 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:47:36.091299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-846c0e70-a26d-401c-bbab-fe7056eba742 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:36.091909 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-846c0e70-a26d-401c-bbab-fe7056eba742 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:36.098774 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846c0e70-a26d-401c-bbab-fe7056eba742 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:36.099225 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846c0e70-a26d-401c-bbab-fe7056eba742 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:36.099972 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846c0e70-a26d-401c-bbab-fe7056eba742 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:36.100403 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-846c0e70-a26d-401c-bbab-fe7056eba742 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:36.231516 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-846c0e70-a26d-401c-bbab-fe7056eba742 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:36.239663 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-846c0e70-a26d-401c-bbab-fe7056eba742 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:36.241218 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-846c0e70-a26d-401c-bbab-fe7056eba742 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:36.242376 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-846c0e70-a26d-401c-bbab-fe7056eba742 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.154912 Jul 25 05:47:36.243540 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 503/995] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:36 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:36.413819 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7d688e11-4deb-48a0-b144-18c214a0af73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:36.414414 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7d688e11-4deb-48a0-b144-18c214a0af73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: bc622d78-aba1-429a-8fe6-b3b0252bc63e] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:36.421799 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7d688e11-4deb-48a0-b144-18c214a0af73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:36.422256 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7d688e11-4deb-48a0-b144-18c214a0af73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:36.423023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7d688e11-4deb-48a0-b144-18c214a0af73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:36.423465 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7d688e11-4deb-48a0-b144-18c214a0af73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:36.437558 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-7d688e11-4deb-48a0-b144-18c214a0af73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] HTTP exception thrown: Instance bc622d78-aba1-429a-8fe6-b3b0252bc63e could not be found. Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7d688e11-4deb-48a0-b144-18c214a0af73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Request method failure captured: Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e HTTP/1.1 Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iyM4iy7GPDLw_QaccoyiJV3b9PTWi1SldICPEtIzdbJYVB6XUnRKwbQ7T9i8_E2IJ_enYBppSBNkSNwVziotGPoqZQ5WHqiFZw4uMU3oUrr_w_9_KjBd2iPMtOFAY5RBp0QHK-fMVvRKr0oZH5_kxx6rJgIHSz44B8nL64lnA31fcY Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: ee638472255a48d2bdffa17a4ff22339 Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:47:36.439202 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ee638472255a48d2bdffa17a4ff22339"}]}] Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: ee638472255a48d2bdffa17a4ff22339 Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-TestVolumeBootPattern-301894717-project Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 1f815f111bf74739969736acea131927 Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-TestVolumeBootPattern-301894717-project Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance bc622d78-aba1-429a-8fe6-b3b0252bc63e could not be found. Jul 25 05:47:36.440740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': 'bc622d78-aba1-429a-8fe6-b3b0252bc63e'} Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc622d78-aba1-429a-8fe6-b3b0252bc63e could not be found. Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:47:36.441707 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc622d78-aba1-429a-8fe6-b3b0252bc63e could not be found. Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc622d78-aba1-429a-8fe6-b3b0252bc63e could not be found. Jul 25 05:47:36.443314 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.444925 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7d688e11-4deb-48a0-b144-18c214a0af73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Returning 404 to user: Instance bc622d78-aba1-429a-8fe6-b3b0252bc63e could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:47:36.444925 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7d688e11-4deb-48a0-b144-18c214a0af73 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e" status: 404 len: 111 microversion: 2.1 time: 0.030739 Jul 25 05:47:36.444925 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 493/996] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:36 2022] GET /compute/v2.1/servers/bc622d78-aba1-429a-8fe6-b3b0252bc63e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:47:36.881971 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7e8bb99d-2822-48e1-9221-cb0577e7cc7d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:36.882480 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7e8bb99d-2822-48e1-9221-cb0577e7cc7d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:36.889114 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7e8bb99d-2822-48e1-9221-cb0577e7cc7d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:36.889601 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7e8bb99d-2822-48e1-9221-cb0577e7cc7d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:36.890374 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7e8bb99d-2822-48e1-9221-cb0577e7cc7d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:36.890829 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7e8bb99d-2822-48e1-9221-cb0577e7cc7d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:36.904618 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-7e8bb99d-2822-48e1-9221-cb0577e7cc7d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] HTTP exception thrown: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7e8bb99d-2822-48e1-9221-cb0577e7cc7d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Request method failure captured: Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: DELETE /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 HTTP/1.1 Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3iyM4iy7GPDLw_QaccoyiJV3b9PTWi1SldICPEtIzdbJYVB6XUnRKwbQ7T9i8_E2IJ_enYBppSBNkSNwVziotGPoqZQ5WHqiFZw4uMU3oUrr_w_9_KjBd2iPMtOFAY5RBp0QHK-fMVvRKr0oZH5_kxx6rJgIHSz44B8nL64lnA31fcY Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: ee638472255a48d2bdffa17a4ff22339 Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:47:36.906315 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ee638472255a48d2bdffa17a4ff22339"}]}] Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: ee638472255a48d2bdffa17a4ff22339 Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-TestVolumeBootPattern-301894717-project Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 1f815f111bf74739969736acea131927 Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-TestVolumeBootPattern-301894717-project Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:47:36.907836 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': 'f6fa910c-7604-4aa9-82ff-477d62f57f54'} Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:47:36.909162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:47:36.910848 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.912733 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7e8bb99d-2822-48e1-9221-cb0577e7cc7d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Returning 404 to user: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:47:36.912733 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7e8bb99d-2822-48e1-9221-cb0577e7cc7d tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 404 len: 111 microversion: 2.1 time: 0.029719 Jul 25 05:47:36.912733 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 504/997] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:47:36 2022] DELETE /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 05:47:36.916391 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e86829a6-92c3-4c29-b4aa-e5494bdc48d3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:36.917028 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e86829a6-92c3-4c29-b4aa-e5494bdc48d3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] [instance: f6fa910c-7604-4aa9-82ff-477d62f57f54] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:36.922934 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e86829a6-92c3-4c29-b4aa-e5494bdc48d3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:36.923392 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e86829a6-92c3-4c29-b4aa-e5494bdc48d3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:36.924243 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e86829a6-92c3-4c29-b4aa-e5494bdc48d3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:36.924674 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e86829a6-92c3-4c29-b4aa-e5494bdc48d3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:36.937779 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-e86829a6-92c3-4c29-b4aa-e5494bdc48d3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] HTTP exception thrown: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e86829a6-92c3-4c29-b4aa-e5494bdc48d3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Request method failure captured: Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 HTTP/1.1 Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3iyM4iy7GPDLw_QaccoyiJV3b9PTWi1SldICPEtIzdbJYVB6XUnRKwbQ7T9i8_E2IJ_enYBppSBNkSNwVziotGPoqZQ5WHqiFZw4uMU3oUrr_w_9_KjBd2iPMtOFAY5RBp0QHK-fMVvRKr0oZH5_kxx6rJgIHSz44B8nL64lnA31fcY Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: ee638472255a48d2bdffa17a4ff22339 Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:47:36.939358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee638472255a48d2bdffa17a4ff22339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ee638472255a48d2bdffa17a4ff22339"}]}] Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: ee638472255a48d2bdffa17a4ff22339 Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-TestVolumeBootPattern-301894717 Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-TestVolumeBootPattern-301894717-project Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 1f815f111bf74739969736acea131927 Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-TestVolumeBootPattern-301894717-project Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:47:36.940983 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': 'f6fa910c-7604-4aa9-82ff-477d62f57f54'} Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:47:36.941974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. Jul 25 05:47:36.943301 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:47:36.944462 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e86829a6-92c3-4c29-b4aa-e5494bdc48d3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Returning 404 to user: Instance f6fa910c-7604-4aa9-82ff-477d62f57f54 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:47:36.944462 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e86829a6-92c3-4c29-b4aa-e5494bdc48d3 tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54" status: 404 len: 111 microversion: 2.1 time: 0.028380 Jul 25 05:47:36.944462 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 494/998] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:47:36 2022] GET /compute/v2.1/servers/f6fa910c-7604-4aa9-82ff-477d62f57f54 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:47:37.261662 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-46eda9c8-5e20-4378-9229-a0ca25d01703 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:37.262201 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-46eda9c8-5e20-4378-9229-a0ca25d01703 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:37.268585 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46eda9c8-5e20-4378-9229-a0ca25d01703 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:37.269065 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46eda9c8-5e20-4378-9229-a0ca25d01703 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:37.269823 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46eda9c8-5e20-4378-9229-a0ca25d01703 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:37.270261 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-46eda9c8-5e20-4378-9229-a0ca25d01703 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:37.403429 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-46eda9c8-5e20-4378-9229-a0ca25d01703 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:37.411469 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-46eda9c8-5e20-4378-9229-a0ca25d01703 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:37.413012 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-46eda9c8-5e20-4378-9229-a0ca25d01703 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:37.414162 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-46eda9c8-5e20-4378-9229-a0ca25d01703 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.157122 Jul 25 05:47:37.414712 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 505/999] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:37 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:38.315462 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9dc2e058-f4be-42ee-878d-8b40bc9b1a6e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] Calling method '.version_select at 0x7fcc842e8550>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:38.336552 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9dc2e058-f4be-42ee-878d-8b40bc9b1a6e tempest-TestVolumeBootPattern-301894717 tempest-TestVolumeBootPattern-301894717-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1985723475" status: 202 len: 0 microversion: 2.1 time: 0.041185 Jul 25 05:47:38.337335 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 495/1000] 10.222.0.33 () {58 vars in 1262 bytes} [Mon Jul 25 05:47:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1985723475 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:47:38.431371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9ca668cb-33b7-4058-adf2-eac81c72610d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:38.432090 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-9ca668cb-33b7-4058-adf2-eac81c72610d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:38.438242 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9ca668cb-33b7-4058-adf2-eac81c72610d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:38.438767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9ca668cb-33b7-4058-adf2-eac81c72610d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:38.439607 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9ca668cb-33b7-4058-adf2-eac81c72610d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:38.440112 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9ca668cb-33b7-4058-adf2-eac81c72610d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:38.686479 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9ca668cb-33b7-4058-adf2-eac81c72610d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:38.694489 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9ca668cb-33b7-4058-adf2-eac81c72610d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:38.696021 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9ca668cb-33b7-4058-adf2-eac81c72610d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:38.697920 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-9ca668cb-33b7-4058-adf2-eac81c72610d tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.270387 Jul 25 05:47:38.698483 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 506/1001] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:38 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:47:39.717655 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c75e9463-d9e3-4734-9375-fd2ee38c2322 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:39.718329 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c75e9463-d9e3-4734-9375-fd2ee38c2322 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:39.728881 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c75e9463-d9e3-4734-9375-fd2ee38c2322 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:39.729355 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c75e9463-d9e3-4734-9375-fd2ee38c2322 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:39.730169 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c75e9463-d9e3-4734-9375-fd2ee38c2322 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:39.730679 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c75e9463-d9e3-4734-9375-fd2ee38c2322 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:39.937731 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c75e9463-d9e3-4734-9375-fd2ee38c2322 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:39.945915 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c75e9463-d9e3-4734-9375-fd2ee38c2322 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:39.947974 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c75e9463-d9e3-4734-9375-fd2ee38c2322 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:39.949478 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c75e9463-d9e3-4734-9375-fd2ee38c2322 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.235858 Jul 25 05:47:39.950120 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 496/1002] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:39 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:40.461085 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-57a62dc2-72bb-43b6-b904-1ee5ad164d73 req-6c26744a-f958-47b8-8c06-c0609745b1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd734fd-ed06-4c5b-828a-e812b5ddec59", "name": "network-vif-plugged", "status": "completed", "tag": "07fab7eb-0b40-4f15-aaa2-f8ee69446342"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:47:40.477634 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-57a62dc2-72bb-43b6-b904-1ee5ad164d73 req-6c26744a-f958-47b8-8c06-c0609745b1cc service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:40.478533 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-57a62dc2-72bb-43b6-b904-1ee5ad164d73 req-6c26744a-f958-47b8-8c06-c0609745b1cc service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:40.490889 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-57a62dc2-72bb-43b6-b904-1ee5ad164d73 req-6c26744a-f958-47b8-8c06-c0609745b1cc service nova] Creating event network-vif-plugged:07fab7eb-0b40-4f15-aaa2-f8ee69446342 for instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 on hv-cinder-85083 Jul 25 05:47:40.497165 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-57a62dc2-72bb-43b6-b904-1ee5ad164d73 req-6c26744a-f958-47b8-8c06-c0609745b1cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039762 Jul 25 05:47:40.498048 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 507/1003] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:47:40.968741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e54e563e-edab-4b27-ab46-36f375dae775 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:40.969804 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e54e563e-edab-4b27-ab46-36f375dae775 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:40.976730 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e54e563e-edab-4b27-ab46-36f375dae775 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:40.977210 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e54e563e-edab-4b27-ab46-36f375dae775 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:40.978795 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e54e563e-edab-4b27-ab46-36f375dae775 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:40.979274 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e54e563e-edab-4b27-ab46-36f375dae775 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:41.416557 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e54e563e-edab-4b27-ab46-36f375dae775 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:41.433777 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e54e563e-edab-4b27-ab46-36f375dae775 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:41.435688 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e54e563e-edab-4b27-ab46-36f375dae775 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:41.437099 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e54e563e-edab-4b27-ab46-36f375dae775 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.472481 Jul 25 05:47:41.438169 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 497/1004] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:40 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:42.458556 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ef3be7a0-49bc-49ca-9214-325964f18fde tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:42.459365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ef3be7a0-49bc-49ca-9214-325964f18fde tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:42.466571 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ef3be7a0-49bc-49ca-9214-325964f18fde tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:42.467114 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ef3be7a0-49bc-49ca-9214-325964f18fde tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:42.467998 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ef3be7a0-49bc-49ca-9214-325964f18fde tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:42.468537 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ef3be7a0-49bc-49ca-9214-325964f18fde tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:42.683012 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ef3be7a0-49bc-49ca-9214-325964f18fde tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:42.691040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ef3be7a0-49bc-49ca-9214-325964f18fde tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:42.692743 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-ef3be7a0-49bc-49ca-9214-325964f18fde tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:42.693961 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ef3be7a0-49bc-49ca-9214-325964f18fde tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1730 microversion: 2.20 time: 0.241379 Jul 25 05:47:42.694533 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 508/1005] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:42 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:47:43.714761 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-953ec814-b47f-474f-a052-2607ced10001 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:47:43.715528 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-953ec814-b47f-474f-a052-2607ced10001 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:47:43.722738 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-953ec814-b47f-474f-a052-2607ced10001 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:43.723313 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-953ec814-b47f-474f-a052-2607ced10001 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:43.724312 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-953ec814-b47f-474f-a052-2607ced10001 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:47:43.724842 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-953ec814-b47f-474f-a052-2607ced10001 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:47:43.955013 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-953ec814-b47f-474f-a052-2607ced10001 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:43.963599 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-953ec814-b47f-474f-a052-2607ced10001 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:43.965218 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-953ec814-b47f-474f-a052-2607ced10001 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:47:43.966410 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-953ec814-b47f-474f-a052-2607ced10001 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1717 microversion: 2.20 time: 0.256365 Jul 25 05:47:43.966978 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 498/1006] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:47:43 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1717 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:48:11.961922 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-839f1cd5-a7c8-4fea-907b-f67c6fa2362f tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:48:11.962506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-839f1cd5-a7c8-4fea-907b-f67c6fa2362f tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:11.965321 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=39 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:11.965984 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=35 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:11.971943 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-839f1cd5-a7c8-4fea-907b-f67c6fa2362f tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:11.972442 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-839f1cd5-a7c8-4fea-907b-f67c6fa2362f tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:11.973181 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-839f1cd5-a7c8-4fea-907b-f67c6fa2362f tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:11.973627 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-839f1cd5-a7c8-4fea-907b-f67c6fa2362f tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:11.997125 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.objects.instance [None req-839f1cd5-a7c8-4fea-907b-f67c6fa2362f tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lazy-loading 'flavor' on Instance uuid 2221cc83-bea9-40a3-8091-ab87d3e19559 {{(pid=124467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:48:12.068385 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-839f1cd5-a7c8-4fea-907b-f67c6fa2362f tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "POST /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559/action" status: 202 len: 0 microversion: 2.1 time: 0.110209 Jul 25 05:48:12.069002 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 509/1007] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:48:11 2022] POST /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:48:12.078444 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-720575e1-9728-4079-92ca-d2b8631bb988 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:12.079099 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-720575e1-9728-4079-92ca-d2b8631bb988 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:12.081195 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:12.081854 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=56 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:12.087945 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-720575e1-9728-4079-92ca-d2b8631bb988 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:12.088998 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-720575e1-9728-4079-92ca-d2b8631bb988 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:12.089920 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-720575e1-9728-4079-92ca-d2b8631bb988 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:12.090373 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-720575e1-9728-4079-92ca-d2b8631bb988 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:12.220379 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-720575e1-9728-4079-92ca-d2b8631bb988 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:12.227831 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-720575e1-9728-4079-92ca-d2b8631bb988 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.153443 Jul 25 05:48:12.228326 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 499/1008] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:12 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:48:13.252482 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5038e3ae-20a3-4cf8-a190-6a2da18fcd8e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:13.253583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5038e3ae-20a3-4cf8-a190-6a2da18fcd8e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:13.261149 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5038e3ae-20a3-4cf8-a190-6a2da18fcd8e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:13.261604 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5038e3ae-20a3-4cf8-a190-6a2da18fcd8e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:13.262371 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5038e3ae-20a3-4cf8-a190-6a2da18fcd8e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:13.262809 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5038e3ae-20a3-4cf8-a190-6a2da18fcd8e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:13.424304 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5038e3ae-20a3-4cf8-a190-6a2da18fcd8e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:13.436049 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5038e3ae-20a3-4cf8-a190-6a2da18fcd8e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.190532 Jul 25 05:48:13.436622 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 510/1009] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:13 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:14.453791 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e6d8b1da-0ae7-42cf-bd53-0f68a31e0032 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:14.454438 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e6d8b1da-0ae7-42cf-bd53-0f68a31e0032 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:14.461032 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6d8b1da-0ae7-42cf-bd53-0f68a31e0032 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:14.461569 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6d8b1da-0ae7-42cf-bd53-0f68a31e0032 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:14.462378 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6d8b1da-0ae7-42cf-bd53-0f68a31e0032 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:14.462931 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6d8b1da-0ae7-42cf-bd53-0f68a31e0032 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:14.591065 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e6d8b1da-0ae7-42cf-bd53-0f68a31e0032 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:14.598515 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e6d8b1da-0ae7-42cf-bd53-0f68a31e0032 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.148715 Jul 25 05:48:14.599080 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 500/1010] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:14 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:15.615541 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f14d3eda-b55d-4ded-bdf4-43b7d7d86681 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:15.616164 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f14d3eda-b55d-4ded-bdf4-43b7d7d86681 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:15.623609 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f14d3eda-b55d-4ded-bdf4-43b7d7d86681 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:15.624057 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f14d3eda-b55d-4ded-bdf4-43b7d7d86681 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:15.624840 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f14d3eda-b55d-4ded-bdf4-43b7d7d86681 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:15.625282 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f14d3eda-b55d-4ded-bdf4-43b7d7d86681 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:15.755764 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f14d3eda-b55d-4ded-bdf4-43b7d7d86681 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:15.763831 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f14d3eda-b55d-4ded-bdf4-43b7d7d86681 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.152200 Jul 25 05:48:15.764394 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 511/1011] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:15 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:16.781190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3e13583a-e758-4e43-ba88-dfe25e77decc tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:16.781803 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3e13583a-e758-4e43-ba88-dfe25e77decc tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:16.788481 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3e13583a-e758-4e43-ba88-dfe25e77decc tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:16.788981 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3e13583a-e758-4e43-ba88-dfe25e77decc tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:16.789754 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3e13583a-e758-4e43-ba88-dfe25e77decc tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:16.791298 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3e13583a-e758-4e43-ba88-dfe25e77decc tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:16.933884 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3e13583a-e758-4e43-ba88-dfe25e77decc tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:16.942094 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3e13583a-e758-4e43-ba88-dfe25e77decc tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.164796 Jul 25 05:48:16.942672 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 501/1012] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:16 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:17.054986 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f1ca5c8c-806b-4250-9fc9-75154c82c405 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:17.056449 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f1ca5c8c-806b-4250-9fc9-75154c82c405 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:17.062901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f1ca5c8c-806b-4250-9fc9-75154c82c405 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:17.063355 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f1ca5c8c-806b-4250-9fc9-75154c82c405 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:17.064120 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f1ca5c8c-806b-4250-9fc9-75154c82c405 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:17.064565 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f1ca5c8c-806b-4250-9fc9-75154c82c405 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:17.093720 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f1ca5c8c-806b-4250-9fc9-75154c82c405 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042678 Jul 25 05:48:17.094281 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 512/1013] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jul 25 05:48:17 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:17.151245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b7d9e3ec-3519-4377-8498-5cf44c39bf87 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:17.151896 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b7d9e3ec-3519-4377-8498-5cf44c39bf87 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:17.157889 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b7d9e3ec-3519-4377-8498-5cf44c39bf87 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:17.158341 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b7d9e3ec-3519-4377-8498-5cf44c39bf87 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:17.159092 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b7d9e3ec-3519-4377-8498-5cf44c39bf87 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:17.159527 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b7d9e3ec-3519-4377-8498-5cf44c39bf87 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:17.186455 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b7d9e3ec-3519-4377-8498-5cf44c39bf87 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:48:17.260616 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b7d9e3ec-3519-4377-8498-5cf44c39bf87 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 204 len: 0 microversion: 2.20 time: 0.113470 Jul 25 05:48:17.261310 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 502/1014] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jul 25 05:48:17 2022] DELETE /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 05:48:17.269459 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-fbe0c91f-6c34-4605-89c0-6ffc56ac3f92 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:17.270075 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-fbe0c91f-6c34-4605-89c0-6ffc56ac3f92 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:17.277219 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fbe0c91f-6c34-4605-89c0-6ffc56ac3f92 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:17.277673 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fbe0c91f-6c34-4605-89c0-6ffc56ac3f92 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:17.278442 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fbe0c91f-6c34-4605-89c0-6ffc56ac3f92 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:17.278884 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-fbe0c91f-6c34-4605-89c0-6ffc56ac3f92 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:17.408246 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-fbe0c91f-6c34-4605-89c0-6ffc56ac3f92 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:17.416787 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-fbe0c91f-6c34-4605-89c0-6ffc56ac3f92 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:17.418293 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-fbe0c91f-6c34-4605-89c0-6ffc56ac3f92 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:17.419439 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-fbe0c91f-6c34-4605-89c0-6ffc56ac3f92 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.153884 Jul 25 05:48:17.419992 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 513/1015] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:48:17 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:48:17.959900 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f5c07ea7-7e35-4349-b7db-b218d438c114 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:17.960596 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f5c07ea7-7e35-4349-b7db-b218d438c114 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:17.967112 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5c07ea7-7e35-4349-b7db-b218d438c114 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:17.967551 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5c07ea7-7e35-4349-b7db-b218d438c114 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:17.968306 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5c07ea7-7e35-4349-b7db-b218d438c114 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:17.968741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5c07ea7-7e35-4349-b7db-b218d438c114 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:18.100860 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f5c07ea7-7e35-4349-b7db-b218d438c114 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:18.109167 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f5c07ea7-7e35-4349-b7db-b218d438c114 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.153208 Jul 25 05:48:18.109727 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 503/1016] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:17 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:18.437633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d96c36d5-a7c0-40ce-b88b-636b53778d97 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:18.438179 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d96c36d5-a7c0-40ce-b88b-636b53778d97 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:18.445016 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d96c36d5-a7c0-40ce-b88b-636b53778d97 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:18.445467 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d96c36d5-a7c0-40ce-b88b-636b53778d97 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:18.446444 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d96c36d5-a7c0-40ce-b88b-636b53778d97 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:18.446878 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d96c36d5-a7c0-40ce-b88b-636b53778d97 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:18.576764 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d96c36d5-a7c0-40ce-b88b-636b53778d97 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:18.584700 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d96c36d5-a7c0-40ce-b88b-636b53778d97 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:18.586280 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d96c36d5-a7c0-40ce-b88b-636b53778d97 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:18.588090 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d96c36d5-a7c0-40ce-b88b-636b53778d97 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1723 microversion: 2.20 time: 0.154482 Jul 25 05:48:18.588650 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 514/1017] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:48:18 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:48:19.127316 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4d94cae8-973c-4ae8-ad53-ea4e69e86dd9 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:19.127940 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4d94cae8-973c-4ae8-ad53-ea4e69e86dd9 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:19.134476 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d94cae8-973c-4ae8-ad53-ea4e69e86dd9 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:19.134934 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d94cae8-973c-4ae8-ad53-ea4e69e86dd9 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:19.135742 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d94cae8-973c-4ae8-ad53-ea4e69e86dd9 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:19.136185 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d94cae8-973c-4ae8-ad53-ea4e69e86dd9 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:19.271191 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4d94cae8-973c-4ae8-ad53-ea4e69e86dd9 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:19.279441 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4d94cae8-973c-4ae8-ad53-ea4e69e86dd9 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.156041 Jul 25 05:48:19.280012 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 504/1018] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:19 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:19.606817 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-73c17ae3-3ffa-4f89-920b-a5cce4779715 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:19.607425 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-73c17ae3-3ffa-4f89-920b-a5cce4779715 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:19.614133 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-73c17ae3-3ffa-4f89-920b-a5cce4779715 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:19.614582 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-73c17ae3-3ffa-4f89-920b-a5cce4779715 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:19.615338 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-73c17ae3-3ffa-4f89-920b-a5cce4779715 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:19.615775 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-73c17ae3-3ffa-4f89-920b-a5cce4779715 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:19.678489 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-73c17ae3-3ffa-4f89-920b-a5cce4779715 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:19.687288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-73c17ae3-3ffa-4f89-920b-a5cce4779715 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:19.688824 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-73c17ae3-3ffa-4f89-920b-a5cce4779715 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:19.690208 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-73c17ae3-3ffa-4f89-920b-a5cce4779715 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1655 microversion: 2.20 time: 0.087275 Jul 25 05:48:19.701193 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 515/1019] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:48:19 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1655 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:48:19.895193 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-6a50309f-3998-4a62-9eeb-faa44275bfe4 req-66a280ad-0189-4f0b-a124-90de8b354ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd734fd-ed06-4c5b-828a-e812b5ddec59", "name": "network-vif-deleted", "tag": "07fab7eb-0b40-4f15-aaa2-f8ee69446342"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:48:19.904640 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-6a50309f-3998-4a62-9eeb-faa44275bfe4 req-66a280ad-0189-4f0b-a124-90de8b354ddf service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:19.906296 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-6a50309f-3998-4a62-9eeb-faa44275bfe4 req-66a280ad-0189-4f0b-a124-90de8b354ddf service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:19.919795 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-6a50309f-3998-4a62-9eeb-faa44275bfe4 req-66a280ad-0189-4f0b-a124-90de8b354ddf service nova] Creating event network-vif-deleted:07fab7eb-0b40-4f15-aaa2-f8ee69446342 for instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 on hv-cinder-85083 Jul 25 05:48:19.924916 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-6a50309f-3998-4a62-9eeb-faa44275bfe4 req-66a280ad-0189-4f0b-a124-90de8b354ddf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170298 Jul 25 05:48:19.925716 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 505/1020] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:48:20.296992 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8b5b36db-d0ae-4b50-a363-1775e5ef8eea tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:20.297633 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8b5b36db-d0ae-4b50-a363-1775e5ef8eea tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:20.303575 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b5b36db-d0ae-4b50-a363-1775e5ef8eea tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:20.304033 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b5b36db-d0ae-4b50-a363-1775e5ef8eea tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:20.305375 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b5b36db-d0ae-4b50-a363-1775e5ef8eea tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:20.305826 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8b5b36db-d0ae-4b50-a363-1775e5ef8eea tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:20.437018 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8b5b36db-d0ae-4b50-a363-1775e5ef8eea tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:20.444615 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8b5b36db-d0ae-4b50-a363-1775e5ef8eea tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.151565 Jul 25 05:48:20.445556 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 516/1021] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:20 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:20.710107 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:20.710814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:20.718081 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:20.718546 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:20.719324 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:20.719764 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:20.752438 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:20.752945 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:20.753406 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lazy-loading 'fault' on Instance uuid 7cd734fd-ed06-4c5b-828a-e812b5ddec59 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:48:20.796032 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:20.807373 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:20.809410 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6973623dc52c402ab51dbf1a7169d3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07879d074bee4b36b1f2f661dc4aeb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:20.810877 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3f260d6c-bd70-4d8c-8003-ba93b349907e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 200 len: 1370 microversion: 2.20 time: 0.105691 Jul 25 05:48:20.816971 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 506/1022] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:48:20 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 1370 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:48:21.461568 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-66230337-d389-4d5c-b084-169ecae87d0a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:21.462319 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-66230337-d389-4d5c-b084-169ecae87d0a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:21.468901 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66230337-d389-4d5c-b084-169ecae87d0a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:21.469353 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66230337-d389-4d5c-b084-169ecae87d0a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:21.470121 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66230337-d389-4d5c-b084-169ecae87d0a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:21.470557 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-66230337-d389-4d5c-b084-169ecae87d0a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:21.605143 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-66230337-d389-4d5c-b084-169ecae87d0a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:21.612844 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-66230337-d389-4d5c-b084-169ecae87d0a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.155111 Jul 25 05:48:21.613417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 517/1023] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:21 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:21.829393 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-69723e6d-256f-47df-b673-d243703bc720 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:21.830002 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-69723e6d-256f-47df-b673-d243703bc720 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:21.836761 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-69723e6d-256f-47df-b673-d243703bc720 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:21.837234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-69723e6d-256f-47df-b673-d243703bc720 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:21.837999 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-69723e6d-256f-47df-b673-d243703bc720 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:21.838436 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-69723e6d-256f-47df-b673-d243703bc720 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:21.851197 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-69723e6d-256f-47df-b673-d243703bc720 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] HTTP exception thrown: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-69723e6d-256f-47df-b673-d243703bc720 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Request method failure captured: Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 HTTP/1.1 Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3i1nWqwf9S3Vsl_Ak7ZNQkIQrfDeSJt-DG-fF_KNfd5gISkikp2d5PtYQRHj3K2OhMxd5pJm68OzjNoQrSAkIC9YgfX0L9ztESDy_btjeK1sIJzW8lcxrhrH4t3TgEkBOS1HyRwau94yekrtXCC39EtUN7XoVHWsCB4-z8x4S6xNMQA Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:48:21.853456 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_07879d074bee4b36b1f2f661dc4aeb7f"}]}] Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 6973623dc52c402ab51dbf1a7169d3e9 Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:21.855208 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '7cd734fd-ed06-4c5b-828a-e812b5ddec59'} Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:48:21.856190 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:21.857814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:21.859575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-69723e6d-256f-47df-b673-d243703bc720 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Returning 404 to user: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:48:21.859575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-69723e6d-256f-47df-b673-d243703bc720 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 404 len: 111 microversion: 2.20 time: 0.029333 Jul 25 05:48:21.859575 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 507/1024] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:48:21 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 05:48:21.864030 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-6a77904a-f9f5-47f4-8379-870c26e94ba6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '.version_select at 0x7fcc844c50d0>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:21.881457 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-6a77904a-f9f5-47f4-8379-870c26e94ba6 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376698411" status: 204 len: 0 microversion: 2.20 time: 0.021279 Jul 25 05:48:21.882003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 518/1025] 10.222.0.33 () {60 vars in 1258 bytes} [Mon Jul 25 05:48:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376698411 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 05:48:22.630634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0288a302-3110-4506-b226-3ec3d87f6d63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:22.631267 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0288a302-3110-4506-b226-3ec3d87f6d63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:22.639506 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0288a302-3110-4506-b226-3ec3d87f6d63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:22.640050 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0288a302-3110-4506-b226-3ec3d87f6d63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:22.640856 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0288a302-3110-4506-b226-3ec3d87f6d63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:22.641311 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0288a302-3110-4506-b226-3ec3d87f6d63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:22.782445 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0288a302-3110-4506-b226-3ec3d87f6d63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:22.790120 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0288a302-3110-4506-b226-3ec3d87f6d63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.163433 Jul 25 05:48:22.790767 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 508/1026] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:22 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:23.654049 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ae31d141-983b-4d94-b6d4-eb99d89e539e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:23.654570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-ae31d141-983b-4d94-b6d4-eb99d89e539e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:23.660444 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ae31d141-983b-4d94-b6d4-eb99d89e539e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:23.660933 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ae31d141-983b-4d94-b6d4-eb99d89e539e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:23.661689 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ae31d141-983b-4d94-b6d4-eb99d89e539e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:23.662126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-ae31d141-983b-4d94-b6d4-eb99d89e539e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:23.677191 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-ae31d141-983b-4d94-b6d4-eb99d89e539e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] HTTP exception thrown: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ae31d141-983b-4d94-b6d4-eb99d89e539e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Request method failure captured: Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: DELETE /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 HTTP/1.1 Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3i1nWqwf9S3Vsl_Ak7ZNQkIQrfDeSJt-DG-fF_KNfd5gISkikp2d5PtYQRHj3K2OhMxd5pJm68OzjNoQrSAkIC9YgfX0L9ztESDy_btjeK1sIJzW8lcxrhrH4t3TgEkBOS1HyRwau94yekrtXCC39EtUN7XoVHWsCB4-z8x4S6xNMQA Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:48:23.678847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_07879d074bee4b36b1f2f661dc4aeb7f"}]}] Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 6973623dc52c402ab51dbf1a7169d3e9 Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:23.680570 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '7cd734fd-ed06-4c5b-828a-e812b5ddec59'} Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:48:23.681639 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:23.683166 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:48:23.684957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-ae31d141-983b-4d94-b6d4-eb99d89e539e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Returning 404 to user: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:48:23.684957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-ae31d141-983b-4d94-b6d4-eb99d89e539e tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 404 len: 111 microversion: 2.20 time: 0.030786 Jul 25 05:48:23.684957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 519/1027] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jul 25 05:48:23 2022] DELETE /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 05:48:23.688635 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5eb992b6-4098-43b4-85d3-3d08ff3353f2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:23.689283 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5eb992b6-4098-43b4-85d3-3d08ff3353f2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: 7cd734fd-ed06-4c5b-828a-e812b5ddec59] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:23.695473 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5eb992b6-4098-43b4-85d3-3d08ff3353f2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:23.695927 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5eb992b6-4098-43b4-85d3-3d08ff3353f2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:23.696684 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5eb992b6-4098-43b4-85d3-3d08ff3353f2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:23.697149 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5eb992b6-4098-43b4-85d3-3d08ff3353f2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:23.714158 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-5eb992b6-4098-43b4-85d3-3d08ff3353f2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] HTTP exception thrown: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5eb992b6-4098-43b4-85d3-3d08ff3353f2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Request method failure captured: Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 HTTP/1.1 Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3i1nWqwf9S3Vsl_Ak7ZNQkIQrfDeSJt-DG-fF_KNfd5gISkikp2d5PtYQRHj3K2OhMxd5pJm68OzjNoQrSAkIC9YgfX0L9ztESDy_btjeK1sIJzW8lcxrhrH4t3TgEkBOS1HyRwau94yekrtXCC39EtUN7XoVHWsCB4-z8x4S6xNMQA Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:48:23.715685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_07879d074bee4b36b1f2f661dc4aeb7f"}]}] Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 6973623dc52c402ab51dbf1a7169d3e9 Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:23.717409 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': '7cd734fd-ed06-4c5b-828a-e812b5ddec59'} Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:48:23.718488 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. Jul 25 05:48:23.720074 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:23.721559 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5eb992b6-4098-43b4-85d3-3d08ff3353f2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Returning 404 to user: Instance 7cd734fd-ed06-4c5b-828a-e812b5ddec59 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:48:23.721559 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5eb992b6-4098-43b4-85d3-3d08ff3353f2 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59" status: 404 len: 111 microversion: 2.20 time: 0.032372 Jul 25 05:48:23.721559 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 509/1028] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:48:23 2022] GET /compute/v2.1/servers/7cd734fd-ed06-4c5b-828a-e812b5ddec59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 05:48:23.808175 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-367a9af8-4bfc-4477-81f9-38fa55961a4a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:23.808890 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-367a9af8-4bfc-4477-81f9-38fa55961a4a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:23.815342 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-367a9af8-4bfc-4477-81f9-38fa55961a4a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:23.815800 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-367a9af8-4bfc-4477-81f9-38fa55961a4a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:23.816580 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-367a9af8-4bfc-4477-81f9-38fa55961a4a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:23.817052 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-367a9af8-4bfc-4477-81f9-38fa55961a4a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:23.947154 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-367a9af8-4bfc-4477-81f9-38fa55961a4a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:23.954562 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-367a9af8-4bfc-4477-81f9-38fa55961a4a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.151200 Jul 25 05:48:23.955122 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 520/1029] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:23 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:24.857916 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1951afbb-24ba-415e-9598-794663f969d7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:24.858422 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1951afbb-24ba-415e-9598-794663f969d7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:24.865085 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1951afbb-24ba-415e-9598-794663f969d7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:24.865547 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1951afbb-24ba-415e-9598-794663f969d7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:24.866907 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1951afbb-24ba-415e-9598-794663f969d7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:24.867584 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1951afbb-24ba-415e-9598-794663f969d7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:24.882116 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-1951afbb-24ba-415e-9598-794663f969d7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] HTTP exception thrown: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1951afbb-24ba-415e-9598-794663f969d7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Request method failure captured: Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a HTTP/1.1 Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Connection: close Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Host: 10.222.0.33 Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABi3i1nWqwf9S3Vsl_Ak7ZNQkIQrfDeSJt-DG-fF_KNfd5gISkikp2d5PtYQRHj3K2OhMxd5pJm68OzjNoQrSAkIC9YgfX0L9ztESDy_btjeK1sIJzW8lcxrhrH4t3TgEkBOS1HyRwau94yekrtXCC39EtUN7XoVHWsCB4-z8x4S6xNMQA Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Role: reader,member Jul 25 05:48:24.883634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Roles: reader,member Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_07879d074bee4b36b1f2f661dc4aeb7f"}]}] Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Id: 6973623dc52c402ab51dbf1a7169d3e9 Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: method: > Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: exception: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:48:24.885449 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: action_args: {'id': 'cbb16475-6c9b-4c00-be15-0b5f68b01d0a'} Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:48:24.886349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:48:24.887774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 25 05:48:24.889232 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1951afbb-24ba-415e-9598-794663f969d7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Returning 404 to user: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:48:24.889232 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1951afbb-24ba-415e-9598-794663f969d7 tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 404 len: 111 microversion: 2.20 time: 0.031644 Jul 25 05:48:24.894299 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1daa41f9-62b6-410b-99bf-8b0b0adcfffd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:24.894981 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 510/1030] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jul 25 05:48:24 2022] DELETE /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 05:48:24.895284 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1daa41f9-62b6-410b-99bf-8b0b0adcfffd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] [instance: cbb16475-6c9b-4c00-be15-0b5f68b01d0a] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:24.903416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1daa41f9-62b6-410b-99bf-8b0b0adcfffd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:24.904527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1daa41f9-62b6-410b-99bf-8b0b0adcfffd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:24.905792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1daa41f9-62b6-410b-99bf-8b0b0adcfffd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:24.906400 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1daa41f9-62b6-410b-99bf-8b0b0adcfffd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:24.920792 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-1daa41f9-62b6-410b-99bf-8b0b0adcfffd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] HTTP exception thrown: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1daa41f9-62b6-410b-99bf-8b0b0adcfffd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Request method failure captured: Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a HTTP/1.1 Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3i1nWqwf9S3Vsl_Ak7ZNQkIQrfDeSJt-DG-fF_KNfd5gISkikp2d5PtYQRHj3K2OhMxd5pJm68OzjNoQrSAkIC9YgfX0L9ztESDy_btjeK1sIJzW8lcxrhrH4t3TgEkBOS1HyRwau94yekrtXCC39EtUN7XoVHWsCB4-z8x4S6xNMQA Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:48:24.922412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/07879d074bee4b36b1f2f661dc4aeb7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_07879d074bee4b36b1f2f661dc4aeb7f"}]}] Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 07879d074bee4b36b1f2f661dc4aeb7f Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1223130607 Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 6973623dc52c402ab51dbf1a7169d3e9 Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1223130607-project Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:48:24.923995 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': 'cbb16475-6c9b-4c00-be15-0b5f68b01d0a'} Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:48:24.925080 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. Jul 25 05:48:24.926611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:48:24.928001 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1daa41f9-62b6-410b-99bf-8b0b0adcfffd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] Returning 404 to user: Instance cbb16475-6c9b-4c00-be15-0b5f68b01d0a could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:48:24.928001 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1daa41f9-62b6-410b-99bf-8b0b0adcfffd tempest-AttachVolumeShelveTestJSON-1223130607 tempest-AttachVolumeShelveTestJSON-1223130607-project] 10.222.0.33 "GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a" status: 404 len: 111 microversion: 2.20 time: 0.033605 Jul 25 05:48:24.928001 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 521/1031] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 25 05:48:24 2022] GET /compute/v2.1/servers/cbb16475-6c9b-4c00-be15-0b5f68b01d0a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 05:48:24.971284 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d0b7e560-0724-4865-9dc1-ba9860ba137a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:24.971897 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d0b7e560-0724-4865-9dc1-ba9860ba137a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:24.978234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d0b7e560-0724-4865-9dc1-ba9860ba137a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:24.978979 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d0b7e560-0724-4865-9dc1-ba9860ba137a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:24.979957 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d0b7e560-0724-4865-9dc1-ba9860ba137a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:24.980625 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d0b7e560-0724-4865-9dc1-ba9860ba137a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:25.426517 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d0b7e560-0724-4865-9dc1-ba9860ba137a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:25.435079 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d0b7e560-0724-4865-9dc1-ba9860ba137a tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.467585 Jul 25 05:48:25.435645 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 511/1032] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:24 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:26.453365 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a784e844-49cc-4c3e-9ffc-76974d3d19cb tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:26.454106 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a784e844-49cc-4c3e-9ffc-76974d3d19cb tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:26.461486 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a784e844-49cc-4c3e-9ffc-76974d3d19cb tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:26.462079 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a784e844-49cc-4c3e-9ffc-76974d3d19cb tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:26.462851 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a784e844-49cc-4c3e-9ffc-76974d3d19cb tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:26.463285 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-a784e844-49cc-4c3e-9ffc-76974d3d19cb tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:26.680425 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a784e844-49cc-4c3e-9ffc-76974d3d19cb tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:26.688009 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a784e844-49cc-4c3e-9ffc-76974d3d19cb tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1510 microversion: 2.1 time: 0.238487 Jul 25 05:48:26.688571 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 522/1033] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:26 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:26.705769 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-41c4e57a-00bd-4c34-8393-57639c2acdc7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:48:26.706390 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-41c4e57a-00bd-4c34-8393-57639c2acdc7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:26.714111 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41c4e57a-00bd-4c34-8393-57639c2acdc7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:26.714770 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41c4e57a-00bd-4c34-8393-57639c2acdc7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:26.715743 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41c4e57a-00bd-4c34-8393-57639c2acdc7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:26.716225 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41c4e57a-00bd-4c34-8393-57639c2acdc7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:26.813893 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR oslo.messaging._drivers.impl_rabbit [None req-41c4e57a-00bd-4c34-8393-57639c2acdc7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [1f950654-5d00-448a-ad48-b493c60c9b72] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 05:48:27.822685 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO oslo.messaging._drivers.impl_rabbit [None req-41c4e57a-00bd-4c34-8393-57639c2acdc7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [1f950654-5d00-448a-ad48-b493c60c9b72] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 33530. Jul 25 05:48:27.826148 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-41c4e57a-00bd-4c34-8393-57639c2acdc7 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "POST /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559/action" status: 202 len: 0 microversion: 2.1 time: 1.124454 Jul 25 05:48:27.827466 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 512/1034] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 25 05:48:26 2022] POST /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559/action => generated 0 bytes in 1126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 05:48:27.836861 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-125498fe-814b-4410-9343-ca42d7d7eb63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:27.838110 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-125498fe-814b-4410-9343-ca42d7d7eb63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:27.847035 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-125498fe-814b-4410-9343-ca42d7d7eb63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:27.847452 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-125498fe-814b-4410-9343-ca42d7d7eb63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:27.848400 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-125498fe-814b-4410-9343-ca42d7d7eb63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:27.849187 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-125498fe-814b-4410-9343-ca42d7d7eb63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:28.057837 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-125498fe-814b-4410-9343-ca42d7d7eb63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:28.068337 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-125498fe-814b-4410-9343-ca42d7d7eb63 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1518 microversion: 2.1 time: 0.236871 Jul 25 05:48:28.069857 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 523/1035] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:27 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:28.537187 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-44db25d0-85d5-4dfd-bcba-7a91fa2b9691 req-d19f46ff-02b6-4b3f-89fe-bf171e7f5278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2221cc83-bea9-40a3-8091-ab87d3e19559", "name": "network-vif-unplugged", "status": "completed", "tag": "1046d76f-597e-40e1-a094-544799c676dd"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:48:28.546374 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-44db25d0-85d5-4dfd-bcba-7a91fa2b9691 req-d19f46ff-02b6-4b3f-89fe-bf171e7f5278 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:28.546755 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-44db25d0-85d5-4dfd-bcba-7a91fa2b9691 req-d19f46ff-02b6-4b3f-89fe-bf171e7f5278 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:28.558864 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.compute.server_external_events [req-44db25d0-85d5-4dfd-bcba-7a91fa2b9691 req-d19f46ff-02b6-4b3f-89fe-bf171e7f5278 service nova] Unable to find a host for instance 2221cc83-bea9-40a3-8091-ab87d3e19559. Dropping event network-vif-unplugged {{(pid=124466) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 05:48:28.559769 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-44db25d0-85d5-4dfd-bcba-7a91fa2b9691 req-d19f46ff-02b6-4b3f-89fe-bf171e7f5278 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.148351 Jul 25 05:48:28.560379 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 513/1036] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 150 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 05:48:29.086575 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-dfa8c675-4f74-437f-a666-c28747d70fc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:29.087222 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-dfa8c675-4f74-437f-a666-c28747d70fc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:29.093765 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dfa8c675-4f74-437f-a666-c28747d70fc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:29.094224 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dfa8c675-4f74-437f-a666-c28747d70fc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:29.095000 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dfa8c675-4f74-437f-a666-c28747d70fc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:29.095444 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-dfa8c675-4f74-437f-a666-c28747d70fc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:29.247786 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-dfa8c675-4f74-437f-a666-c28747d70fc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:29.256548 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-dfa8c675-4f74-437f-a666-c28747d70fc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1518 microversion: 2.1 time: 0.173542 Jul 25 05:48:29.257310 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 524/1037] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:29 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:30.273407 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1f267f96-08a5-4769-ac46-e7ebec257226 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:30.274033 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1f267f96-08a5-4769-ac46-e7ebec257226 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:30.280428 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1f267f96-08a5-4769-ac46-e7ebec257226 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:30.280922 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1f267f96-08a5-4769-ac46-e7ebec257226 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:30.281693 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1f267f96-08a5-4769-ac46-e7ebec257226 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:30.282136 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1f267f96-08a5-4769-ac46-e7ebec257226 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:30.427026 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1f267f96-08a5-4769-ac46-e7ebec257226 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:30.435748 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1f267f96-08a5-4769-ac46-e7ebec257226 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1518 microversion: 2.1 time: 0.166541 Jul 25 05:48:30.436318 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 514/1038] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:30 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:31.453072 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-508b6a6a-3ef1-47fd-ad00-b15dc742f373 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:31.453698 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-508b6a6a-3ef1-47fd-ad00-b15dc742f373 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:31.461197 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-508b6a6a-3ef1-47fd-ad00-b15dc742f373 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:31.461652 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-508b6a6a-3ef1-47fd-ad00-b15dc742f373 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:31.462418 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-508b6a6a-3ef1-47fd-ad00-b15dc742f373 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:31.462862 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-508b6a6a-3ef1-47fd-ad00-b15dc742f373 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:31.598054 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-508b6a6a-3ef1-47fd-ad00-b15dc742f373 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:31.601791 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:31.607232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-508b6a6a-3ef1-47fd-ad00-b15dc742f373 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1518 microversion: 2.1 time: 0.157929 Jul 25 05:48:31.607866 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 525/1039] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:31 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:32.625142 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-feeae6fc-131e-4380-a30e-086ff22545a2 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:32.625774 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-feeae6fc-131e-4380-a30e-086ff22545a2 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:32.632745 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-feeae6fc-131e-4380-a30e-086ff22545a2 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:32.633228 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-feeae6fc-131e-4380-a30e-086ff22545a2 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:32.633989 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-feeae6fc-131e-4380-a30e-086ff22545a2 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:32.634421 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-feeae6fc-131e-4380-a30e-086ff22545a2 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:32.764119 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-feeae6fc-131e-4380-a30e-086ff22545a2 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:32.767634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:32.773262 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-feeae6fc-131e-4380-a30e-086ff22545a2 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1518 microversion: 2.1 time: 0.151789 Jul 25 05:48:32.773829 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 515/1040] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:32 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:33.790757 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-2e90759b-5880-403d-973d-b130fefb5010 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:33.791374 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-2e90759b-5880-403d-973d-b130fefb5010 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:33.799132 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2e90759b-5880-403d-973d-b130fefb5010 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:33.799597 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2e90759b-5880-403d-973d-b130fefb5010 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:33.800356 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2e90759b-5880-403d-973d-b130fefb5010 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:33.800818 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-2e90759b-5880-403d-973d-b130fefb5010 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:33.932313 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-2e90759b-5880-403d-973d-b130fefb5010 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:33.940107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-2e90759b-5880-403d-973d-b130fefb5010 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1520 microversion: 2.1 time: 0.153701 Jul 25 05:48:33.940689 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 526/1041] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:33 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:34.958978 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-53f3c2af-3c41-4f3b-906b-415998df3f9e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:34.959839 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-53f3c2af-3c41-4f3b-906b-415998df3f9e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:34.967361 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53f3c2af-3c41-4f3b-906b-415998df3f9e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:34.967814 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53f3c2af-3c41-4f3b-906b-415998df3f9e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:34.968583 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53f3c2af-3c41-4f3b-906b-415998df3f9e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:34.969053 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53f3c2af-3c41-4f3b-906b-415998df3f9e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:35.104860 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-53f3c2af-3c41-4f3b-906b-415998df3f9e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:35.112573 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-53f3c2af-3c41-4f3b-906b-415998df3f9e tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1520 microversion: 2.1 time: 0.157501 Jul 25 05:48:35.113160 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 516/1042] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:34 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:36.130443 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-8d4df2a0-65c6-483b-b3df-3ab5f34d0287 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:36.131294 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-8d4df2a0-65c6-483b-b3df-3ab5f34d0287 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:36.137787 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8d4df2a0-65c6-483b-b3df-3ab5f34d0287 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:36.138239 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8d4df2a0-65c6-483b-b3df-3ab5f34d0287 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:36.138997 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8d4df2a0-65c6-483b-b3df-3ab5f34d0287 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:36.139434 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-8d4df2a0-65c6-483b-b3df-3ab5f34d0287 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:36.277301 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-8d4df2a0-65c6-483b-b3df-3ab5f34d0287 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:36.284689 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-8d4df2a0-65c6-483b-b3df-3ab5f34d0287 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1520 microversion: 2.1 time: 0.158567 Jul 25 05:48:36.285305 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 527/1043] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:36 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:37.302962 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6b294131-94ed-4714-9acd-66a382d35d2c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:37.303615 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6b294131-94ed-4714-9acd-66a382d35d2c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:37.310623 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b294131-94ed-4714-9acd-66a382d35d2c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:37.311463 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b294131-94ed-4714-9acd-66a382d35d2c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:37.312328 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b294131-94ed-4714-9acd-66a382d35d2c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:37.312868 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b294131-94ed-4714-9acd-66a382d35d2c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:37.457480 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6b294131-94ed-4714-9acd-66a382d35d2c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:37.465431 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6b294131-94ed-4714-9acd-66a382d35d2c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.167174 Jul 25 05:48:37.475562 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 517/1044] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:37 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:38.482876 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-d9f8e494-9805-42cd-b8d4-de99a303c108 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:38.483485 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-d9f8e494-9805-42cd-b8d4-de99a303c108 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:38.490332 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d9f8e494-9805-42cd-b8d4-de99a303c108 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:38.490791 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d9f8e494-9805-42cd-b8d4-de99a303c108 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:38.491548 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d9f8e494-9805-42cd-b8d4-de99a303c108 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:38.491981 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-d9f8e494-9805-42cd-b8d4-de99a303c108 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:38.619118 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-d9f8e494-9805-42cd-b8d4-de99a303c108 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:38.626667 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-d9f8e494-9805-42cd-b8d4-de99a303c108 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.148087 Jul 25 05:48:38.627236 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 528/1045] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:38 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:39.643388 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-67459bc6-bdc8-49d3-bc2e-5ff0282165f0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:39.644023 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-67459bc6-bdc8-49d3-bc2e-5ff0282165f0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:39.651166 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-67459bc6-bdc8-49d3-bc2e-5ff0282165f0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:39.651615 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-67459bc6-bdc8-49d3-bc2e-5ff0282165f0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:39.652366 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-67459bc6-bdc8-49d3-bc2e-5ff0282165f0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:39.652816 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-67459bc6-bdc8-49d3-bc2e-5ff0282165f0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:39.789603 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-67459bc6-bdc8-49d3-bc2e-5ff0282165f0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:39.797267 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-67459bc6-bdc8-49d3-bc2e-5ff0282165f0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.157727 Jul 25 05:48:39.797865 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 518/1046] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:39 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:40.814501 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-468c964e-868e-424e-a657-687ab723ec85 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:40.815116 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-468c964e-868e-424e-a657-687ab723ec85 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:40.821960 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-468c964e-868e-424e-a657-687ab723ec85 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:40.822416 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-468c964e-868e-424e-a657-687ab723ec85 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:40.823176 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-468c964e-868e-424e-a657-687ab723ec85 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:40.823615 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-468c964e-868e-424e-a657-687ab723ec85 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:40.953854 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-468c964e-868e-424e-a657-687ab723ec85 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:40.962492 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-468c964e-868e-424e-a657-687ab723ec85 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.151820 Jul 25 05:48:40.963072 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 529/1047] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:40 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:48:41.980143 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b3e9aa3a-792a-4ce7-bf81-397fa51e21f3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:41.980765 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b3e9aa3a-792a-4ce7-bf81-397fa51e21f3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:41.987291 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3e9aa3a-792a-4ce7-bf81-397fa51e21f3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:41.987746 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3e9aa3a-792a-4ce7-bf81-397fa51e21f3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:41.988571 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3e9aa3a-792a-4ce7-bf81-397fa51e21f3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:41.989704 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3e9aa3a-792a-4ce7-bf81-397fa51e21f3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:42.125979 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b3e9aa3a-792a-4ce7-bf81-397fa51e21f3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:42.133412 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b3e9aa3a-792a-4ce7-bf81-397fa51e21f3 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.157515 Jul 25 05:48:42.133975 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 519/1048] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:41 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:43.150455 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f9138270-55b2-4bf9-87f3-54f4f051b029 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:43.151063 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f9138270-55b2-4bf9-87f3-54f4f051b029 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:43.153397 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:43.158638 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f9138270-55b2-4bf9-87f3-54f4f051b029 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:43.159083 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f9138270-55b2-4bf9-87f3-54f4f051b029 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:43.159841 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f9138270-55b2-4bf9-87f3-54f4f051b029 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:43.160275 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-f9138270-55b2-4bf9-87f3-54f4f051b029 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:43.293847 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f9138270-55b2-4bf9-87f3-54f4f051b029 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:43.301897 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f9138270-55b2-4bf9-87f3-54f4f051b029 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.154799 Jul 25 05:48:43.302554 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 530/1049] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:43 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:44.320635 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-32d76fed-660c-4512-8c29-20d6ff0948ac tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:44.321390 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-32d76fed-660c-4512-8c29-20d6ff0948ac tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:44.325173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:44.329719 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-32d76fed-660c-4512-8c29-20d6ff0948ac tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:44.330337 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-32d76fed-660c-4512-8c29-20d6ff0948ac tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:44.331429 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-32d76fed-660c-4512-8c29-20d6ff0948ac tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:44.331896 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-32d76fed-660c-4512-8c29-20d6ff0948ac tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:44.466669 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-32d76fed-660c-4512-8c29-20d6ff0948ac tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:44.474198 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-32d76fed-660c-4512-8c29-20d6ff0948ac tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.159078 Jul 25 05:48:44.474767 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 520/1050] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:44 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:45.491349 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-72d51528-f3f3-45de-aae8-cb2f27696e18 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:45.491947 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-72d51528-f3f3-45de-aae8-cb2f27696e18 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:45.498690 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-72d51528-f3f3-45de-aae8-cb2f27696e18 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:45.499142 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-72d51528-f3f3-45de-aae8-cb2f27696e18 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:45.499914 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-72d51528-f3f3-45de-aae8-cb2f27696e18 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:45.500356 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-72d51528-f3f3-45de-aae8-cb2f27696e18 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:45.637288 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-72d51528-f3f3-45de-aae8-cb2f27696e18 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:45.646099 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-72d51528-f3f3-45de-aae8-cb2f27696e18 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.158587 Jul 25 05:48:45.647040 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 531/1051] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:45 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:46.664753 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-06ed1de3-b2f5-4149-8344-faed9cbf614c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:46.665417 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-06ed1de3-b2f5-4149-8344-faed9cbf614c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:46.671789 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06ed1de3-b2f5-4149-8344-faed9cbf614c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:46.672243 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06ed1de3-b2f5-4149-8344-faed9cbf614c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:46.673048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06ed1de3-b2f5-4149-8344-faed9cbf614c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:46.673493 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06ed1de3-b2f5-4149-8344-faed9cbf614c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:46.809697 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-06ed1de3-b2f5-4149-8344-faed9cbf614c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:46.818607 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-06ed1de3-b2f5-4149-8344-faed9cbf614c tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.158486 Jul 25 05:48:46.819195 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 521/1052] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:46 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:47.836228 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7746f30a-294c-457c-8987-ea16a0c0efc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:47.836902 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7746f30a-294c-457c-8987-ea16a0c0efc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:47.843440 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7746f30a-294c-457c-8987-ea16a0c0efc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:47.843899 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7746f30a-294c-457c-8987-ea16a0c0efc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:47.844667 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7746f30a-294c-457c-8987-ea16a0c0efc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:47.845145 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7746f30a-294c-457c-8987-ea16a0c0efc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:47.983140 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7746f30a-294c-457c-8987-ea16a0c0efc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:47.990827 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7746f30a-294c-457c-8987-ea16a0c0efc1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.159249 Jul 25 05:48:47.991420 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 532/1053] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:47 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:48.515628 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-7bcaf380-134e-4844-85de-fbb5bf3495d9 req-2a97422c-eb41-40f7-9859-e953431d1d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2221cc83-bea9-40a3-8091-ab87d3e19559", "name": "network-vif-plugged", "status": "completed", "tag": "1046d76f-597e-40e1-a094-544799c676dd"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:48:48.525253 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-7bcaf380-134e-4844-85de-fbb5bf3495d9 req-2a97422c-eb41-40f7-9859-e953431d1d32 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:48.525713 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-7bcaf380-134e-4844-85de-fbb5bf3495d9 req-2a97422c-eb41-40f7-9859-e953431d1d32 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:48.537674 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-7bcaf380-134e-4844-85de-fbb5bf3495d9 req-2a97422c-eb41-40f7-9859-e953431d1d32 service nova] Creating event network-vif-plugged:1046d76f-597e-40e1-a094-544799c676dd for instance 2221cc83-bea9-40a3-8091-ab87d3e19559 on hv-cinder-85083 Jul 25 05:48:48.542696 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-7bcaf380-134e-4844-85de-fbb5bf3495d9 req-2a97422c-eb41-40f7-9859-e953431d1d32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030830 Jul 25 05:48:48.543296 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 522/1054] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:48:49.007071 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9503da0b-c03b-406f-9e2a-f81fb056a611 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:49.007723 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-9503da0b-c03b-406f-9e2a-f81fb056a611 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:49.014280 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9503da0b-c03b-406f-9e2a-f81fb056a611 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:49.014735 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9503da0b-c03b-406f-9e2a-f81fb056a611 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:49.015507 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9503da0b-c03b-406f-9e2a-f81fb056a611 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:49.015952 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9503da0b-c03b-406f-9e2a-f81fb056a611 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:49.151235 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-9503da0b-c03b-406f-9e2a-f81fb056a611 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:49.159030 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-9503da0b-c03b-406f-9e2a-f81fb056a611 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.155925 Jul 25 05:48:49.160739 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 533/1055] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:49 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:50.177741 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bb12ff13-5ff7-4130-bf1a-ce393c3feb4d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:50.178332 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bb12ff13-5ff7-4130-bf1a-ce393c3feb4d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:50.185214 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb12ff13-5ff7-4130-bf1a-ce393c3feb4d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:50.185665 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb12ff13-5ff7-4130-bf1a-ce393c3feb4d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:50.186425 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb12ff13-5ff7-4130-bf1a-ce393c3feb4d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:50.186862 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb12ff13-5ff7-4130-bf1a-ce393c3feb4d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:50.337712 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bb12ff13-5ff7-4130-bf1a-ce393c3feb4d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:50.345227 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bb12ff13-5ff7-4130-bf1a-ce393c3feb4d tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1576 microversion: 2.1 time: 0.172052 Jul 25 05:48:50.345810 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 523/1056] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:50 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:48:51.362332 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5ed8c342-f121-4598-a765-46a9e63deeb0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:48:51.364105 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5ed8c342-f121-4598-a765-46a9e63deeb0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:48:51.370629 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5ed8c342-f121-4598-a765-46a9e63deeb0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:51.371088 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5ed8c342-f121-4598-a765-46a9e63deeb0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:51.371851 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5ed8c342-f121-4598-a765-46a9e63deeb0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:48:51.372294 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5ed8c342-f121-4598-a765-46a9e63deeb0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:48:51.510210 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5ed8c342-f121-4598-a765-46a9e63deeb0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:48:51.518439 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5ed8c342-f121-4598-a765-46a9e63deeb0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1563 microversion: 2.1 time: 0.159904 Jul 25 05:48:51.519576 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 534/1057] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:48:51 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:25.283670 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-673856003", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "networks": [{"uuid": "22f08d8a-ca18-4670-91f5-b3cbdf9412e3"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:49:25.290385 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=7 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:25.291178 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=44 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:25.337545 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] validate_networks() for [('22f08d8a-ca18-4670-91f5-b3cbdf9412e3', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:49:25.736945 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:49:25.737369 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:49:25.737848 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:49:25.738261 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:49:25.738681 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:49:25.747496 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:25.747949 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:25.748789 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:25.749245 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:25.766948 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Getting quotas for project c8a1790f9a76478eab9dd2bbe8941b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:49:25.771458 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Getting quotas for user 010a94640af34bd18e5a873af1527bb0 and project c8a1790f9a76478eab9dd2bbe8941b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:49:25.782564 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:49:25.784892 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:49:25.831339 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-85f5a384-1aa0-4529-8be0-09ea2c810f72 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550257 Jul 25 05:49:25.834168 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 524/1058] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:49:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:49:25.842033 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-f3c831e2-d9bb-4461-bf0c-16b6f6fa0eeb tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:25.842668 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-f3c831e2-d9bb-4461-bf0c-16b6f6fa0eeb tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:25.844692 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=9 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:25.846417 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=54 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:25.900044 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-f3c831e2-d9bb-4461-bf0c-16b6f6fa0eeb tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:25.906708 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-f3c831e2-d9bb-4461-bf0c-16b6f6fa0eeb tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1213 microversion: 2.1 time: 0.068628 Jul 25 05:49:25.907386 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 535/1059] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:25 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:26.924144 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-af4aaced-b363-4c17-a62d-574b49c552f3 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:26.925180 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-af4aaced-b363-4c17-a62d-574b49c552f3 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:26.931725 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-af4aaced-b363-4c17-a62d-574b49c552f3 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:26.932260 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-af4aaced-b363-4c17-a62d-574b49c552f3 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:26.933555 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-af4aaced-b363-4c17-a62d-574b49c552f3 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:26.934106 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-af4aaced-b363-4c17-a62d-574b49c552f3 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:27.001804 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-af4aaced-b363-4c17-a62d-574b49c552f3 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:27.011751 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-af4aaced-b363-4c17-a62d-574b49c552f3 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1273 microversion: 2.1 time: 0.092030 Jul 25 05:49:27.012546 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 525/1060] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:26 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:28.029322 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-5fc74669-38f3-4d11-9c38-429d82dd2af0 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:28.030048 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-5fc74669-38f3-4d11-9c38-429d82dd2af0 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:28.037849 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5fc74669-38f3-4d11-9c38-429d82dd2af0 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:28.038017 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5fc74669-38f3-4d11-9c38-429d82dd2af0 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:28.038746 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5fc74669-38f3-4d11-9c38-429d82dd2af0 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:28.039193 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-5fc74669-38f3-4d11-9c38-429d82dd2af0 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:28.179126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-5fc74669-38f3-4d11-9c38-429d82dd2af0 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:28.187823 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-5fc74669-38f3-4d11-9c38-429d82dd2af0 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1313 microversion: 2.1 time: 0.162292 Jul 25 05:49:28.188483 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 536/1061] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:28 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:28.201364 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-bd46b0cf-ad93-4f12-93eb-933a584a6bfe req-f260a57d-9a63-4fbd-b62f-262f4532a1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998a32e2-ab7c-4bb0-921d-333c41eab559", "tag": "9f77ab3e-99fe-4ba6-be7a-9c04359d4f2c"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:49:28.212168 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-bd46b0cf-ad93-4f12-93eb-933a584a6bfe req-f260a57d-9a63-4fbd-b62f-262f4532a1e1 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:28.212840 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-bd46b0cf-ad93-4f12-93eb-933a584a6bfe req-f260a57d-9a63-4fbd-b62f-262f4532a1e1 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:28.225467 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-bd46b0cf-ad93-4f12-93eb-933a584a6bfe req-f260a57d-9a63-4fbd-b62f-262f4532a1e1 service nova] Creating event network-changed:9f77ab3e-99fe-4ba6-be7a-9c04359d4f2c for instance 998a32e2-ab7c-4bb0-921d-333c41eab559 on hv-cinder-85083 Jul 25 05:49:28.230417 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-bd46b0cf-ad93-4f12-93eb-933a584a6bfe req-f260a57d-9a63-4fbd-b62f-262f4532a1e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032897 Jul 25 05:49:28.231701 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 526/1062] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:49:29.204935 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-e13ae2f7-256d-44d4-b156-6a0fa4177116 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:29.205609 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-e13ae2f7-256d-44d4-b156-6a0fa4177116 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:29.212184 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e13ae2f7-256d-44d4-b156-6a0fa4177116 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:29.212638 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e13ae2f7-256d-44d4-b156-6a0fa4177116 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:29.213431 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e13ae2f7-256d-44d4-b156-6a0fa4177116 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:29.213871 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-e13ae2f7-256d-44d4-b156-6a0fa4177116 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:29.346674 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-e13ae2f7-256d-44d4-b156-6a0fa4177116 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:29.354892 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-e13ae2f7-256d-44d4-b156-6a0fa4177116 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1313 microversion: 2.1 time: 0.153876 Jul 25 05:49:29.355448 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 537/1063] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:29 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:30.373159 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1db11ddf-65be-4268-93bb-b5744003c598 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:30.373869 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1db11ddf-65be-4268-93bb-b5744003c598 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:30.381369 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1db11ddf-65be-4268-93bb-b5744003c598 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:30.381830 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1db11ddf-65be-4268-93bb-b5744003c598 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:30.382600 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1db11ddf-65be-4268-93bb-b5744003c598 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:30.383048 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1db11ddf-65be-4268-93bb-b5744003c598 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:30.511063 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1db11ddf-65be-4268-93bb-b5744003c598 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:30.518566 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1db11ddf-65be-4268-93bb-b5744003c598 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1313 microversion: 2.1 time: 0.149662 Jul 25 05:49:30.519139 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 527/1064] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:30 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:31.536113 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-b2bd4ca0-f1ca-468d-aacd-018a1d980539 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:31.536728 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-b2bd4ca0-f1ca-468d-aacd-018a1d980539 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:31.543212 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b2bd4ca0-f1ca-468d-aacd-018a1d980539 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:31.543664 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b2bd4ca0-f1ca-468d-aacd-018a1d980539 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:31.544424 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b2bd4ca0-f1ca-468d-aacd-018a1d980539 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:31.544900 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-b2bd4ca0-f1ca-468d-aacd-018a1d980539 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:31.676516 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-b2bd4ca0-f1ca-468d-aacd-018a1d980539 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:31.683941 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-b2bd4ca0-f1ca-468d-aacd-018a1d980539 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1313 microversion: 2.1 time: 0.152441 Jul 25 05:49:31.684503 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 538/1065] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:31 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:32.693941 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-34a46eb5-4133-4308-b7e1-4649b9666623 req-df54d06e-06ec-4605-a1b0-5821ee79383a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998a32e2-ab7c-4bb0-921d-333c41eab559", "name": "network-vif-plugged", "status": "completed", "tag": "9f77ab3e-99fe-4ba6-be7a-9c04359d4f2c"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:49:32.701345 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-88d61cc6-c752-4301-92c4-3a688852e1b7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:32.702076 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-88d61cc6-c752-4301-92c4-3a688852e1b7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:32.703322 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-34a46eb5-4133-4308-b7e1-4649b9666623 req-df54d06e-06ec-4605-a1b0-5821ee79383a service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:32.703943 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-34a46eb5-4133-4308-b7e1-4649b9666623 req-df54d06e-06ec-4605-a1b0-5821ee79383a service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:32.709112 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-88d61cc6-c752-4301-92c4-3a688852e1b7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:32.710237 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-88d61cc6-c752-4301-92c4-3a688852e1b7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:32.710683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-88d61cc6-c752-4301-92c4-3a688852e1b7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:32.711009 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-88d61cc6-c752-4301-92c4-3a688852e1b7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:32.720225 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-34a46eb5-4133-4308-b7e1-4649b9666623 req-df54d06e-06ec-4605-a1b0-5821ee79383a service nova] Creating event network-vif-plugged:9f77ab3e-99fe-4ba6-be7a-9c04359d4f2c for instance 998a32e2-ab7c-4bb0-921d-333c41eab559 on hv-cinder-85083 Jul 25 05:49:32.725732 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-34a46eb5-4133-4308-b7e1-4649b9666623 req-df54d06e-06ec-4605-a1b0-5821ee79383a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036112 Jul 25 05:49:32.726502 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 528/1066] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:49:32.849860 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-88d61cc6-c752-4301-92c4-3a688852e1b7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:32.857361 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-88d61cc6-c752-4301-92c4-3a688852e1b7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1313 microversion: 2.1 time: 0.159971 Jul 25 05:49:32.857922 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 539/1067] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:32 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:33.874327 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-42e9e42c-841d-43d0-832b-f9ab7362a341 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:33.875025 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-42e9e42c-841d-43d0-832b-f9ab7362a341 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:33.882927 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-42e9e42c-841d-43d0-832b-f9ab7362a341 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:33.883374 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-42e9e42c-841d-43d0-832b-f9ab7362a341 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:33.884133 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-42e9e42c-841d-43d0-832b-f9ab7362a341 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:33.884570 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-42e9e42c-841d-43d0-832b-f9ab7362a341 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:34.014838 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-42e9e42c-841d-43d0-832b-f9ab7362a341 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:34.022788 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-42e9e42c-841d-43d0-832b-f9ab7362a341 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1313 microversion: 2.1 time: 0.152646 Jul 25 05:49:34.023356 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 529/1068] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:33 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:35.040444 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-aa0866c0-af96-48f0-ad39-237332c3bbc7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:35.041083 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-aa0866c0-af96-48f0-ad39-237332c3bbc7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:35.047670 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aa0866c0-af96-48f0-ad39-237332c3bbc7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:35.048067 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aa0866c0-af96-48f0-ad39-237332c3bbc7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:35.048850 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aa0866c0-af96-48f0-ad39-237332c3bbc7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:35.049292 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-aa0866c0-af96-48f0-ad39-237332c3bbc7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:35.176877 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-aa0866c0-af96-48f0-ad39-237332c3bbc7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:35.184401 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-aa0866c0-af96-48f0-ad39-237332c3bbc7 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1497 microversion: 2.1 time: 0.147930 Jul 25 05:49:35.184994 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 540/1069] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:35 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:49:35.672059 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5b02b50e-87e9-4120-8c54-a59b53b3e70b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:35.672571 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5b02b50e-87e9-4120-8c54-a59b53b3e70b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:35.679520 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b02b50e-87e9-4120-8c54-a59b53b3e70b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:35.679979 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b02b50e-87e9-4120-8c54-a59b53b3e70b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:35.680747 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b02b50e-87e9-4120-8c54-a59b53b3e70b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:35.681224 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b02b50e-87e9-4120-8c54-a59b53b3e70b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:35.706128 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5b02b50e-87e9-4120-8c54-a59b53b3e70b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:49:35.757766 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:35.777919 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=6 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:35.783053 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5b02b50e-87e9-4120-8c54-a59b53b3e70b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "DELETE /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 204 len: 0 microversion: 2.1 time: 0.114594 Jul 25 05:49:35.783739 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 530/1070] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:49:35 2022] DELETE /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:35.792430 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-67c42d68-2b58-46a7-b5bf-e9bbd6efcf3b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:35.793075 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-67c42d68-2b58-46a7-b5bf-e9bbd6efcf3b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:35.799107 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-67c42d68-2b58-46a7-b5bf-e9bbd6efcf3b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:35.799558 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-67c42d68-2b58-46a7-b5bf-e9bbd6efcf3b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:35.800966 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-67c42d68-2b58-46a7-b5bf-e9bbd6efcf3b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:35.801412 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-67c42d68-2b58-46a7-b5bf-e9bbd6efcf3b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:35.904269 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=2 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:35.930955 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-67c42d68-2b58-46a7-b5bf-e9bbd6efcf3b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:35.938314 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-67c42d68-2b58-46a7-b5bf-e9bbd6efcf3b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1503 microversion: 2.1 time: 0.149685 Jul 25 05:49:35.938881 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 541/1071] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:35 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:36.961355 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-de65eda1-8b39-4136-accb-346dd99e276e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:36.961977 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-de65eda1-8b39-4136-accb-346dd99e276e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:36.967989 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de65eda1-8b39-4136-accb-346dd99e276e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:36.968438 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de65eda1-8b39-4136-accb-346dd99e276e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:36.969223 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de65eda1-8b39-4136-accb-346dd99e276e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:36.969660 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de65eda1-8b39-4136-accb-346dd99e276e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:37.100389 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-de65eda1-8b39-4136-accb-346dd99e276e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:37.107846 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-de65eda1-8b39-4136-accb-346dd99e276e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1503 microversion: 2.1 time: 0.152266 Jul 25 05:49:37.108405 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 531/1072] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:36 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:37.810295 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-b64ad977-8ce8-486d-ae0b-eca97ab848d0 req-372e478d-6ab0-49d6-a782-d195cd2cfbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998a32e2-ab7c-4bb0-921d-333c41eab559", "name": "network-vif-deleted", "tag": "9f77ab3e-99fe-4ba6-be7a-9c04359d4f2c"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:49:37.819273 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-b64ad977-8ce8-486d-ae0b-eca97ab848d0 req-372e478d-6ab0-49d6-a782-d195cd2cfbc7 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:37.819686 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-b64ad977-8ce8-486d-ae0b-eca97ab848d0 req-372e478d-6ab0-49d6-a782-d195cd2cfbc7 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:37.835873 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-b64ad977-8ce8-486d-ae0b-eca97ab848d0 req-372e478d-6ab0-49d6-a782-d195cd2cfbc7 service nova] Creating event network-vif-deleted:9f77ab3e-99fe-4ba6-be7a-9c04359d4f2c for instance 998a32e2-ab7c-4bb0-921d-333c41eab559 on hv-cinder-85083 Jul 25 05:49:37.840998 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-b64ad977-8ce8-486d-ae0b-eca97ab848d0 req-372e478d-6ab0-49d6-a782-d195cd2cfbc7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034386 Jul 25 05:49:37.841600 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 542/1073] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:49:38.125080 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fa0e7dae-0c3f-47c1-9fba-426ac6d4ed16 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:38.125696 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fa0e7dae-0c3f-47c1-9fba-426ac6d4ed16 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:38.132652 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa0e7dae-0c3f-47c1-9fba-426ac6d4ed16 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:38.133133 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa0e7dae-0c3f-47c1-9fba-426ac6d4ed16 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:38.133894 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa0e7dae-0c3f-47c1-9fba-426ac6d4ed16 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:38.134332 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa0e7dae-0c3f-47c1-9fba-426ac6d4ed16 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:38.164437 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa0e7dae-0c3f-47c1-9fba-426ac6d4ed16 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:38.164915 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa0e7dae-0c3f-47c1-9fba-426ac6d4ed16 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:38.165358 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-fa0e7dae-0c3f-47c1-9fba-426ac6d4ed16 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lazy-loading 'fault' on Instance uuid 998a32e2-ab7c-4bb0-921d-333c41eab559 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:49:38.205302 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fa0e7dae-0c3f-47c1-9fba-426ac6d4ed16 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:38.213554 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fa0e7dae-0c3f-47c1-9fba-426ac6d4ed16 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 200 len: 1303 microversion: 2.1 time: 0.092445 Jul 25 05:49:38.214112 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 532/1074] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:38 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:39.231117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3d660f11-0152-4eab-895f-647bd52268a8 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:39.231731 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-3d660f11-0152-4eab-895f-647bd52268a8 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 998a32e2-ab7c-4bb0-921d-333c41eab559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:39.239516 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3d660f11-0152-4eab-895f-647bd52268a8 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:39.239965 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3d660f11-0152-4eab-895f-647bd52268a8 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:39.240715 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3d660f11-0152-4eab-895f-647bd52268a8 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:39.241178 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-3d660f11-0152-4eab-895f-647bd52268a8 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:39.255071 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-3d660f11-0152-4eab-895f-647bd52268a8 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] HTTP exception thrown: Instance 998a32e2-ab7c-4bb0-921d-333c41eab559 could not be found. Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3d660f11-0152-4eab-895f-647bd52268a8 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Request method failure captured: Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 HTTP/1.1 Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3i7jCGDpH8hP7LJLghJXSFl8a9Bk5FhzRWwOUbX3aFURP0PjIGohPEgmL3BTYZbAVelfn0rO-82FnJHzCrMOJZkSJBfYULPZZ-NdTZq86gxyk3W7Vg8fyO4yFx5u19sSO4g8LwLSBzKALfFZWz1cjTY6o_TLUl5mDLsDDsemVWXatjw Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: c8a1790f9a76478eab9dd2bbe8941b8f Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-VolumesActionsTest-1864640330 Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:49:39.256654 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8a1790f9a76478eab9dd2bbe8941b8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8a1790f9a76478eab9dd2bbe8941b8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8a1790f9a76478eab9dd2bbe8941b8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8a1790f9a76478eab9dd2bbe8941b8f"}]}] Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-VolumesActionsTest-1864640330 Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: c8a1790f9a76478eab9dd2bbe8941b8f Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-VolumesActionsTest-1864640330 Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-VolumesActionsTest-1864640330-project Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 010a94640af34bd18e5a873af1527bb0 Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-VolumesActionsTest-1864640330-project Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 998a32e2-ab7c-4bb0-921d-333c41eab559 could not be found. Jul 25 05:49:39.258402 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '998a32e2-ab7c-4bb0-921d-333c41eab559'} Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 998a32e2-ab7c-4bb0-921d-333c41eab559 could not be found. Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:49:39.259462 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 998a32e2-ab7c-4bb0-921d-333c41eab559 could not be found. Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 998a32e2-ab7c-4bb0-921d-333c41eab559 could not be found. Jul 25 05:49:39.261126 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:49:39.262646 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-3d660f11-0152-4eab-895f-647bd52268a8 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Returning 404 to user: Instance 998a32e2-ab7c-4bb0-921d-333c41eab559 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:49:39.262646 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-3d660f11-0152-4eab-895f-647bd52268a8 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559" status: 404 len: 111 microversion: 2.1 time: 0.031218 Jul 25 05:49:39.262646 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 543/1075] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:39 2022] GET /compute/v2.1/servers/998a32e2-ab7c-4bb0-921d-333c41eab559 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:49:39.304952 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-573330542", "imageRef": "922e9db9-44de-4903-90c5-f0705c1df9db", "flavorRef": "452", "networks": [{"uuid": "22f08d8a-ca18-4670-91f5-b3cbdf9412e3"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:49:39.356540 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] validate_networks() for [('22f08d8a-ca18-4670-91f5-b3cbdf9412e3', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:49:39.698942 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:49:39.699367 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:49:39.699866 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:49:39.700303 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:49:39.700717 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:49:39.710493 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:39.710951 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:39.711757 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:39.712199 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:39.729029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Getting quotas for project c8a1790f9a76478eab9dd2bbe8941b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:49:39.732991 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Getting quotas for user 010a94640af34bd18e5a873af1527bb0 and project c8a1790f9a76478eab9dd2bbe8941b8f. Resources: {'instances', 'ram', 'cores'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:49:39.743873 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:49:39.746164 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='922e9db9-44de-4903-90c5-f0705c1df9db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:49:39.792316 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-82330a0b-5fa5-4f3a-904e-39f8ef0c258a tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491148 Jul 25 05:49:39.793009 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 533/1076] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 25 05:49:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:49:39.805426 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-a87ae688-4abd-4814-ad5c-2fe5631aedd4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:39.806038 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-a87ae688-4abd-4814-ad5c-2fe5631aedd4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:39.861572 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-a87ae688-4abd-4814-ad5c-2fe5631aedd4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:39.867988 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-a87ae688-4abd-4814-ad5c-2fe5631aedd4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1213 microversion: 2.1 time: 0.066386 Jul 25 05:49:39.868550 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 544/1077] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:39 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:49:40.886214 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9cb5b0c5-f3d7-4cbe-9d27-85b6b806da64 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:40.886765 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9cb5b0c5-f3d7-4cbe-9d27-85b6b806da64 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:40.896899 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9cb5b0c5-f3d7-4cbe-9d27-85b6b806da64 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:40.897361 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9cb5b0c5-f3d7-4cbe-9d27-85b6b806da64 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:40.898139 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9cb5b0c5-f3d7-4cbe-9d27-85b6b806da64 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:40.898820 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9cb5b0c5-f3d7-4cbe-9d27-85b6b806da64 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:40.973349 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9cb5b0c5-f3d7-4cbe-9d27-85b6b806da64 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:40.980690 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9cb5b0c5-f3d7-4cbe-9d27-85b6b806da64 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1283 microversion: 2.1 time: 0.099028 Jul 25 05:49:40.981280 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 534/1078] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:40 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1283 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:49:41.997632 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-339b3088-6b95-401d-8fc9-cacfc485ffec tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:41.998229 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-339b3088-6b95-401d-8fc9-cacfc485ffec tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:42.006945 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-339b3088-6b95-401d-8fc9-cacfc485ffec tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:42.007807 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-339b3088-6b95-401d-8fc9-cacfc485ffec tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:42.008590 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-339b3088-6b95-401d-8fc9-cacfc485ffec tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:42.009053 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-339b3088-6b95-401d-8fc9-cacfc485ffec tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:42.139413 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-339b3088-6b95-401d-8fc9-cacfc485ffec tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:42.147575 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-339b3088-6b95-401d-8fc9-cacfc485ffec tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1313 microversion: 2.1 time: 0.153800 Jul 25 05:49:42.148135 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 545/1079] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:41 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:42.176331 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-9013982d-826b-41b1-9670-f49a2091c819 req-f8d128bd-0541-42cb-9e9c-64c42d957c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc0cb88-68d6-4727-9095-71d08196d6b1", "tag": "321e80ac-9564-4f3d-acac-6d281d534f5a"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:49:42.185687 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-9013982d-826b-41b1-9670-f49a2091c819 req-f8d128bd-0541-42cb-9e9c-64c42d957c42 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:42.186168 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-9013982d-826b-41b1-9670-f49a2091c819 req-f8d128bd-0541-42cb-9e9c-64c42d957c42 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:42.198322 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-9013982d-826b-41b1-9670-f49a2091c819 req-f8d128bd-0541-42cb-9e9c-64c42d957c42 service nova] Creating event network-changed:321e80ac-9564-4f3d-acac-6d281d534f5a for instance 6fc0cb88-68d6-4727-9095-71d08196d6b1 on hv-cinder-85083 Jul 25 05:49:42.203052 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-9013982d-826b-41b1-9670-f49a2091c819 req-f8d128bd-0541-42cb-9e9c-64c42d957c42 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031443 Jul 25 05:49:42.203846 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 535/1080] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:49:43.165007 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7f36c8bd-306a-49c1-b7a1-40cdca9b6970 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:43.165553 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7f36c8bd-306a-49c1-b7a1-40cdca9b6970 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:43.172019 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f36c8bd-306a-49c1-b7a1-40cdca9b6970 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:43.172468 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f36c8bd-306a-49c1-b7a1-40cdca9b6970 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:43.173248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f36c8bd-306a-49c1-b7a1-40cdca9b6970 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:43.173807 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7f36c8bd-306a-49c1-b7a1-40cdca9b6970 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:43.306474 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-7f36c8bd-306a-49c1-b7a1-40cdca9b6970 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:43.313938 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7f36c8bd-306a-49c1-b7a1-40cdca9b6970 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1313 microversion: 2.1 time: 0.152873 Jul 25 05:49:43.315152 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 546/1081] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:43 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:44.332963 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c4c1dbae-5d87-460f-b424-a5242888847e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:44.333660 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c4c1dbae-5d87-460f-b424-a5242888847e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:44.339779 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4c1dbae-5d87-460f-b424-a5242888847e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:44.340229 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4c1dbae-5d87-460f-b424-a5242888847e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:44.341019 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4c1dbae-5d87-460f-b424-a5242888847e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:44.341458 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4c1dbae-5d87-460f-b424-a5242888847e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:44.467763 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c4c1dbae-5d87-460f-b424-a5242888847e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:44.475653 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c4c1dbae-5d87-460f-b424-a5242888847e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1313 microversion: 2.1 time: 0.148108 Jul 25 05:49:44.476197 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 536/1082] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:44 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:45.491979 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-affce4ec-ed69-4107-a956-428fb9b51602 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:45.492586 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-affce4ec-ed69-4107-a956-428fb9b51602 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:45.499078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-affce4ec-ed69-4107-a956-428fb9b51602 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:45.499523 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-affce4ec-ed69-4107-a956-428fb9b51602 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:45.500269 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-affce4ec-ed69-4107-a956-428fb9b51602 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:45.500700 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-affce4ec-ed69-4107-a956-428fb9b51602 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:45.626340 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-affce4ec-ed69-4107-a956-428fb9b51602 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:45.634183 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-affce4ec-ed69-4107-a956-428fb9b51602 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1313 microversion: 2.1 time: 0.146050 Jul 25 05:49:45.634750 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 547/1083] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:45 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:46.651474 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-81dee604-9daa-409c-bad9-063d494e74ea tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:46.652118 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-81dee604-9daa-409c-bad9-063d494e74ea tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:46.659209 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-81dee604-9daa-409c-bad9-063d494e74ea tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:46.659664 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-81dee604-9daa-409c-bad9-063d494e74ea tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:46.660432 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-81dee604-9daa-409c-bad9-063d494e74ea tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:46.660894 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-81dee604-9daa-409c-bad9-063d494e74ea tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:46.806184 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-81dee604-9daa-409c-bad9-063d494e74ea tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:46.813831 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-81dee604-9daa-409c-bad9-063d494e74ea tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1313 microversion: 2.1 time: 0.166173 Jul 25 05:49:46.814737 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 537/1084] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:46 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:46.847507 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-a699db58-23f1-4c0d-bb60-6aa47062b2a0 req-ee21c6f3-7e02-4cec-9917-613145998c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc0cb88-68d6-4727-9095-71d08196d6b1", "name": "network-vif-plugged", "status": "completed", "tag": "321e80ac-9564-4f3d-acac-6d281d534f5a"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:49:46.856248 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-a699db58-23f1-4c0d-bb60-6aa47062b2a0 req-ee21c6f3-7e02-4cec-9917-613145998c53 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:46.856705 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-a699db58-23f1-4c0d-bb60-6aa47062b2a0 req-ee21c6f3-7e02-4cec-9917-613145998c53 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:46.869919 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-a699db58-23f1-4c0d-bb60-6aa47062b2a0 req-ee21c6f3-7e02-4cec-9917-613145998c53 service nova] Creating event network-vif-plugged:321e80ac-9564-4f3d-acac-6d281d534f5a for instance 6fc0cb88-68d6-4727-9095-71d08196d6b1 on hv-cinder-85083 Jul 25 05:49:46.875054 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-a699db58-23f1-4c0d-bb60-6aa47062b2a0 req-ee21c6f3-7e02-4cec-9917-613145998c53 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031786 Jul 25 05:49:46.875640 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 548/1085] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:49:47.831438 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-33b7f2c2-9851-4e8b-957a-dbfb7708d55c tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:47.832045 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-33b7f2c2-9851-4e8b-957a-dbfb7708d55c tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:47.838444 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33b7f2c2-9851-4e8b-957a-dbfb7708d55c tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:47.838893 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33b7f2c2-9851-4e8b-957a-dbfb7708d55c tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:47.839674 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33b7f2c2-9851-4e8b-957a-dbfb7708d55c tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:47.840133 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33b7f2c2-9851-4e8b-957a-dbfb7708d55c tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:47.966607 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-33b7f2c2-9851-4e8b-957a-dbfb7708d55c tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:47.974430 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-33b7f2c2-9851-4e8b-957a-dbfb7708d55c tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1313 microversion: 2.1 time: 0.147548 Jul 25 05:49:47.974997 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 538/1086] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:47 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:48.991620 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-104ad056-8405-470c-8d48-4b0e0eb43e7b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:48.993526 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-104ad056-8405-470c-8d48-4b0e0eb43e7b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:49.000281 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-104ad056-8405-470c-8d48-4b0e0eb43e7b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:49.000807 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-104ad056-8405-470c-8d48-4b0e0eb43e7b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:49.001611 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-104ad056-8405-470c-8d48-4b0e0eb43e7b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:49.002053 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-104ad056-8405-470c-8d48-4b0e0eb43e7b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:49.386664 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-104ad056-8405-470c-8d48-4b0e0eb43e7b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:49.394476 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-104ad056-8405-470c-8d48-4b0e0eb43e7b tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1497 microversion: 2.1 time: 0.407525 Jul 25 05:49:49.395038 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 549/1087] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:48 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1497 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:49.894951 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-220cbf28-9f7b-4679-b6b5-2b7eb5cb568e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:49.895469 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-220cbf28-9f7b-4679-b6b5-2b7eb5cb568e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:49.897839 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:49.898646 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=6 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:49.904305 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-220cbf28-9f7b-4679-b6b5-2b7eb5cb568e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:49.904760 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-220cbf28-9f7b-4679-b6b5-2b7eb5cb568e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:49.905550 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-220cbf28-9f7b-4679-b6b5-2b7eb5cb568e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:49.905997 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-220cbf28-9f7b-4679-b6b5-2b7eb5cb568e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:49.931727 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-220cbf28-9f7b-4679-b6b5-2b7eb5cb568e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:49:50.004748 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-220cbf28-9f7b-4679-b6b5-2b7eb5cb568e tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 204 len: 0 microversion: 2.1 time: 0.114334 Jul 25 05:49:50.005353 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 539/1088] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:49:49 2022] DELETE /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:50.014976 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-08693dc8-243b-438e-96a0-fba105c594e9 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:50.015627 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-08693dc8-243b-438e-96a0-fba105c594e9 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:50.018177 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell0:SELECT=2 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:50.024122 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-08693dc8-243b-438e-96a0-fba105c594e9 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:50.024583 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-08693dc8-243b-438e-96a0-fba105c594e9 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:50.025403 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-08693dc8-243b-438e-96a0-fba105c594e9 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:50.025835 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-08693dc8-243b-438e-96a0-fba105c594e9 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:50.154179 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-08693dc8-243b-438e-96a0-fba105c594e9 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:50.161798 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-08693dc8-243b-438e-96a0-fba105c594e9 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1503 microversion: 2.1 time: 0.151091 Jul 25 05:49:50.162353 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 550/1089] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:50 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:51.179957 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-29f0fd2a-84ac-4d2a-9b66-d36e371aae02 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:51.180580 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-29f0fd2a-84ac-4d2a-9b66-d36e371aae02 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:51.186957 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-29f0fd2a-84ac-4d2a-9b66-d36e371aae02 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:51.187408 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-29f0fd2a-84ac-4d2a-9b66-d36e371aae02 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:51.188839 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-29f0fd2a-84ac-4d2a-9b66-d36e371aae02 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:51.189297 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-29f0fd2a-84ac-4d2a-9b66-d36e371aae02 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:51.193249 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:51.322328 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-29f0fd2a-84ac-4d2a-9b66-d36e371aae02 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:51.330173 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-29f0fd2a-84ac-4d2a-9b66-d36e371aae02 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1503 microversion: 2.1 time: 0.154571 Jul 25 05:49:51.330740 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 540/1090] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:51 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:52.048910 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-c7401fdd-e143-4eb5-aa5e-6ab0e9c2017a req-76452230-dd33-4202-89a9-1c38ab533a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc0cb88-68d6-4727-9095-71d08196d6b1", "name": "network-vif-deleted", "tag": "321e80ac-9564-4f3d-acac-6d281d534f5a"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:49:52.058313 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-c7401fdd-e143-4eb5-aa5e-6ab0e9c2017a req-76452230-dd33-4202-89a9-1c38ab533a8f service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:52.058744 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-c7401fdd-e143-4eb5-aa5e-6ab0e9c2017a req-76452230-dd33-4202-89a9-1c38ab533a8f service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:52.070641 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-c7401fdd-e143-4eb5-aa5e-6ab0e9c2017a req-76452230-dd33-4202-89a9-1c38ab533a8f service nova] Creating event network-vif-deleted:321e80ac-9564-4f3d-acac-6d281d534f5a for instance 6fc0cb88-68d6-4727-9095-71d08196d6b1 on hv-cinder-85083 Jul 25 05:49:52.077693 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-c7401fdd-e143-4eb5-aa5e-6ab0e9c2017a req-76452230-dd33-4202-89a9-1c38ab533a8f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032677 Jul 25 05:49:52.079238 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 551/1091] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:49:52.348634 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-076df0de-680b-4f1d-ba30-55098c50dac4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:52.349307 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-076df0de-680b-4f1d-ba30-55098c50dac4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:52.355724 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-076df0de-680b-4f1d-ba30-55098c50dac4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:52.356172 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-076df0de-680b-4f1d-ba30-55098c50dac4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:52.356955 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-076df0de-680b-4f1d-ba30-55098c50dac4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:52.357393 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-076df0de-680b-4f1d-ba30-55098c50dac4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:52.387377 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-076df0de-680b-4f1d-ba30-55098c50dac4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:52.387825 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-076df0de-680b-4f1d-ba30-55098c50dac4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:52.388269 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-076df0de-680b-4f1d-ba30-55098c50dac4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lazy-loading 'fault' on Instance uuid 6fc0cb88-68d6-4727-9095-71d08196d6b1 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:49:52.428191 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-076df0de-680b-4f1d-ba30-55098c50dac4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010a94640af34bd18e5a873af1527bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a1790f9a76478eab9dd2bbe8941b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:49:52.435419 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-076df0de-680b-4f1d-ba30-55098c50dac4 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 200 len: 1303 microversion: 2.1 time: 0.091075 Jul 25 05:49:52.435981 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 541/1092] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:52 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:53.454694 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9c4041de-44bc-41f3-82fa-5c8febb86e01 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:49:53.455396 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-9c4041de-44bc-41f3-82fa-5c8febb86e01 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] [instance: 6fc0cb88-68d6-4727-9095-71d08196d6b1] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:49:53.461613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9c4041de-44bc-41f3-82fa-5c8febb86e01 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:53.462066 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9c4041de-44bc-41f3-82fa-5c8febb86e01 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:53.462824 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9c4041de-44bc-41f3-82fa-5c8febb86e01 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:49:53.463263 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-9c4041de-44bc-41f3-82fa-5c8febb86e01 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:49:53.477767 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-9c4041de-44bc-41f3-82fa-5c8febb86e01 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] HTTP exception thrown: Instance 6fc0cb88-68d6-4727-9095-71d08196d6b1 could not be found. Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9c4041de-44bc-41f3-82fa-5c8febb86e01 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Request method failure captured: Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 HTTP/1.1 Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3i7jCGDpH8hP7LJLghJXSFl8a9Bk5FhzRWwOUbX3aFURP0PjIGohPEgmL3BTYZbAVelfn0rO-82FnJHzCrMOJZkSJBfYULPZZ-NdTZq86gxyk3W7Vg8fyO4yFx5u19sSO4g8LwLSBzKALfFZWz1cjTY6o_TLUl5mDLsDDsemVWXatjw Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: c8a1790f9a76478eab9dd2bbe8941b8f Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-VolumesActionsTest-1864640330 Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:49:53.479343 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c8a1790f9a76478eab9dd2bbe8941b8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8a1790f9a76478eab9dd2bbe8941b8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c8a1790f9a76478eab9dd2bbe8941b8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c8a1790f9a76478eab9dd2bbe8941b8f"}]}] Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-VolumesActionsTest-1864640330 Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: c8a1790f9a76478eab9dd2bbe8941b8f Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-VolumesActionsTest-1864640330 Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-VolumesActionsTest-1864640330-project Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 010a94640af34bd18e5a873af1527bb0 Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-VolumesActionsTest-1864640330-project Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 6fc0cb88-68d6-4727-9095-71d08196d6b1 could not be found. Jul 25 05:49:53.481003 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '6fc0cb88-68d6-4727-9095-71d08196d6b1'} Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc0cb88-68d6-4727-9095-71d08196d6b1 could not be found. Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:49:53.482117 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc0cb88-68d6-4727-9095-71d08196d6b1 could not be found. Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc0cb88-68d6-4727-9095-71d08196d6b1 could not be found. Jul 25 05:49:53.483865 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:49:53.486660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-9c4041de-44bc-41f3-82fa-5c8febb86e01 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] Returning 404 to user: Instance 6fc0cb88-68d6-4727-9095-71d08196d6b1 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:49:53.486660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-9c4041de-44bc-41f3-82fa-5c8febb86e01 tempest-VolumesActionsTest-1864640330 tempest-VolumesActionsTest-1864640330-project] 10.222.0.33 "GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1" status: 404 len: 111 microversion: 2.1 time: 0.031536 Jul 25 05:49:53.486660 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 552/1093] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:49:53 2022] GET /compute/v2.1/servers/6fc0cb88-68d6-4727-9095-71d08196d6b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:50:11.626825 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-512ef0c9-54b9-4bfa-91c3-663a45de00a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:50:11.627514 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-512ef0c9-54b9-4bfa-91c3-663a45de00a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:50:11.629542 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.630816 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=12 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.632902 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_api:SELECT=40 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.633887 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG dbcounter [-] [124467] Writing DB stats nova_cell1:SELECT=76 {{(pid=124467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.653458 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-512ef0c9-54b9-4bfa-91c3-663a45de00a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:11.654060 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-512ef0c9-54b9-4bfa-91c3-663a45de00a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:11.656043 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-512ef0c9-54b9-4bfa-91c3-663a45de00a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:11.656573 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-512ef0c9-54b9-4bfa-91c3-663a45de00a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:11.706126 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-512ef0c9-54b9-4bfa-91c3-663a45de00a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 05:50:11.812305 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-8bb22934-2864-4d54-9297-c2a80b1ec1fb req-6ae63ebe-e064-4466-aa41-1f890ecb7d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2221cc83-bea9-40a3-8091-ab87d3e19559", "tag": "1046d76f-597e-40e1-a094-544799c676dd"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:50:11.822290 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-8bb22934-2864-4d54-9297-c2a80b1ec1fb req-6ae63ebe-e064-4466-aa41-1f890ecb7d5d service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:11.822955 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-8bb22934-2864-4d54-9297-c2a80b1ec1fb req-6ae63ebe-e064-4466-aa41-1f890ecb7d5d service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:11.846732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-8bb22934-2864-4d54-9297-c2a80b1ec1fb req-6ae63ebe-e064-4466-aa41-1f890ecb7d5d service nova] Creating event network-changed:1046d76f-597e-40e1-a094-544799c676dd for instance 2221cc83-bea9-40a3-8091-ab87d3e19559 on hv-cinder-85083 Jul 25 05:50:11.853335 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-512ef0c9-54b9-4bfa-91c3-663a45de00a0 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 204 len: 0 microversion: 2.1 time: 0.231481 Jul 25 05:50:11.854997 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 542/1094] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 25 05:50:11 2022] DELETE /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:11.859049 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-8bb22934-2864-4d54-9297-c2a80b1ec1fb req-6ae63ebe-e064-4466-aa41-1f890ecb7d5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227616 Jul 25 05:50:11.860195 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 553/1095] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:50:11.866516 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-24ee0fa0-4e79-40ae-b01a-8c52efefa9b1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:50:11.867234 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-24ee0fa0-4e79-40ae-b01a-8c52efefa9b1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:50:11.874311 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-24ee0fa0-4e79-40ae-b01a-8c52efefa9b1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:11.874696 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-24ee0fa0-4e79-40ae-b01a-8c52efefa9b1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:11.876249 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-24ee0fa0-4e79-40ae-b01a-8c52efefa9b1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:11.876249 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-24ee0fa0-4e79-40ae-b01a-8c52efefa9b1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:12.040761 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-24ee0fa0-4e79-40ae-b01a-8c52efefa9b1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:50:12.049018 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-24ee0fa0-4e79-40ae-b01a-8c52efefa9b1 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.188859 Jul 25 05:50:12.061322 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 543/1096] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:50:11 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:50:13.067955 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-1cee3d4b-36b7-4231-84ba-ddede53d9e34 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:50:13.068662 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-1cee3d4b-36b7-4231-84ba-ddede53d9e34 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:50:13.074909 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1cee3d4b-36b7-4231-84ba-ddede53d9e34 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:13.075405 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1cee3d4b-36b7-4231-84ba-ddede53d9e34 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:13.076221 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1cee3d4b-36b7-4231-84ba-ddede53d9e34 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:13.076666 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-1cee3d4b-36b7-4231-84ba-ddede53d9e34 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:13.220658 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.policy [None req-1cee3d4b-36b7-4231-84ba-ddede53d9e34 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124467) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:50:13.228282 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-1cee3d4b-36b7-4231-84ba-ddede53d9e34 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.164854 Jul 25 05:50:13.238606 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 554/1097] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:50:13 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:14.247557 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-12beff99-ec51-4270-be2d-f951be580aa6 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:50:14.248660 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-12beff99-ec51-4270-be2d-f951be580aa6 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:50:14.260915 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-12beff99-ec51-4270-be2d-f951be580aa6 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:14.262417 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-12beff99-ec51-4270-be2d-f951be580aa6 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:14.264609 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-12beff99-ec51-4270-be2d-f951be580aa6 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:14.265435 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-12beff99-ec51-4270-be2d-f951be580aa6 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:14.502288 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-12beff99-ec51-4270-be2d-f951be580aa6 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:50:14.511395 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-12beff99-ec51-4270-be2d-f951be580aa6 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1569 microversion: 2.1 time: 0.268594 Jul 25 05:50:14.526848 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 544/1098] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:50:14 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1569 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:14.683351 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [req-50a99b06-d9c5-41c6-a63b-c13c3d8a9b8d req-f0ef6526-1e36-4f3b-ac04-96a2e7bdc884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2221cc83-bea9-40a3-8091-ab87d3e19559", "name": "network-vif-deleted", "tag": "1046d76f-597e-40e1-a094-544799c676dd"}]} {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:50:14.695608 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-50a99b06-d9c5-41c6-a63b-c13c3d8a9b8d req-f0ef6526-1e36-4f3b-ac04-96a2e7bdc884 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:14.697506 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [req-50a99b06-d9c5-41c6-a63b-c13c3d8a9b8d req-f0ef6526-1e36-4f3b-ac04-96a2e7bdc884 service nova] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:14.727917 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.compute.server_external_events [req-50a99b06-d9c5-41c6-a63b-c13c3d8a9b8d req-f0ef6526-1e36-4f3b-ac04-96a2e7bdc884 service nova] Creating event network-vif-deleted:1046d76f-597e-40e1-a094-544799c676dd for instance 2221cc83-bea9-40a3-8091-ab87d3e19559 on hv-cinder-85083 Jul 25 05:50:14.734726 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [req-50a99b06-d9c5-41c6-a63b-c13c3d8a9b8d req-f0ef6526-1e36-4f3b-ac04-96a2e7bdc884 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056048 Jul 25 05:50:14.735527 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 555/1099] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 25 05:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:50:15.533922 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-06b608eb-237a-4388-9a0a-159c800dd476 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:50:15.534655 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-06b608eb-237a-4388-9a0a-159c800dd476 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:50:15.541029 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06b608eb-237a-4388-9a0a-159c800dd476 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:15.541495 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06b608eb-237a-4388-9a0a-159c800dd476 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:15.542319 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06b608eb-237a-4388-9a0a-159c800dd476 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:15.542769 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06b608eb-237a-4388-9a0a-159c800dd476 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:15.578647 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06b608eb-237a-4388-9a0a-159c800dd476 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:15.579114 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-06b608eb-237a-4388-9a0a-159c800dd476 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:15.579581 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-06b608eb-237a-4388-9a0a-159c800dd476 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lazy-loading 'fault' on Instance uuid 2221cc83-bea9-40a3-8091-ab87d3e19559 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 05:50:15.627032 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-06b608eb-237a-4388-9a0a-159c800dd476 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1574ee677bad49d190a0f82827d5aade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354d7ebd6b454fb5a601a2a78a88561e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:50:15.633942 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-06b608eb-237a-4388-9a0a-159c800dd476 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 200 len: 1178 microversion: 2.1 time: 0.104210 Jul 25 05:50:15.634500 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 545/1100] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:50:15 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 1178 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:50:16.652612 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7b75db5a-069e-451a-9324-8b61a1c248bd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '>' {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:50:16.653395 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.compute.api [None req-7b75db5a-069e-451a-9324-8b61a1c248bd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [instance: 2221cc83-bea9-40a3-8091-ab87d3e19559] Fetching instance by UUID {{(pid=124467) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:50:16.660237 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7b75db5a-069e-451a-9324-8b61a1c248bd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:16.660683 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7b75db5a-069e-451a-9324-8b61a1c248bd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:16.661468 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7b75db5a-069e-451a-9324-8b61a1c248bd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:16.661906 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG oslo_concurrency.lockutils [None req-7b75db5a-069e-451a-9324-8b61a1c248bd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Lock "a0027c59-0b1b-4d95-bca5-9cf989836553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:16.675613 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.wsgi [None req-7b75db5a-069e-451a-9324-8b61a1c248bd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] HTTP exception thrown: Instance 2221cc83-bea9-40a3-8091-ab87d3e19559 could not be found. Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7b75db5a-069e-451a-9324-8b61a1c248bd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Request method failure captured: Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: request: GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 HTTP/1.1 Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept: application/json Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Accept-Encoding: identity Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Connection: close Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Length: 0 Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Content-Type: application/json Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Host: 10.222.0.33 Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Openstack-System-Scope: None Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: User-Agent: python-urllib3/1.26.9 Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Auth-Token: gAAAAABi3i33rwboes5Xzrt04BCWU3BbWZgroilY46JfDiiBv6XDz6uw2sHXNL8WsuPmIq0aQtylEhcAgDCg3gwOK40S7J5BE-iOmvDqNAVifHn5xqeXV0VShgKzchGgOD0jkU7gJXBTHdCwxXgVe6ld-0V2A8-w8ZMPkjCWRG6Z9UzV-GY4LSY Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Id: None Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Domain-Name: None Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Identity-Status: Confirmed Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Is-Admin-Project: True Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Id: default Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Domain-Name: Default Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Id: 354d7ebd6b454fb5a601a2a78a88561e Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Project-Name: tempest-TestShelveInstance-38130555 Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Role: reader,member Jul 25 05:50:16.677232 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Roles: reader,member Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/354d7ebd6b454fb5a601a2a78a88561e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/354d7ebd6b454fb5a601a2a78a88561e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/354d7ebd6b454fb5a601a2a78a88561e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_354d7ebd6b454fb5a601a2a78a88561e"}]}] Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant: tempest-TestShelveInstance-38130555 Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Id: 354d7ebd6b454fb5a601a2a78a88561e Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-Tenant-Name: tempest-TestShelveInstance-38130555 Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User: tempest-TestShelveInstance-38130555-project Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Id: default Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Domain-Name: Default Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Id: 1574ee677bad49d190a0f82827d5aade Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: X-User-Name: tempest-TestShelveInstance-38130555-project Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: method: > Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: exception: Instance 2221cc83-bea9-40a3-8091-ab87d3e19559 could not be found. Jul 25 05:50:16.679036 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: action_args: {'id': '2221cc83-bea9-40a3-8091-ab87d3e19559'} Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: {{(pid=124467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2221cc83-bea9-40a3-8091-ab87d3e19559 could not be found. Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:50:16.680078 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2221cc83-bea9-40a3-8091-ab87d3e19559 could not be found. Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2221cc83-bea9-40a3-8091-ab87d3e19559 could not be found. Jul 25 05:50:16.681732 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: ERROR nova.api.openstack.wsgi Jul 25 05:50:16.683139 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: DEBUG nova.api.openstack.wsgi [None req-7b75db5a-069e-451a-9324-8b61a1c248bd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Returning 404 to user: Instance 2221cc83-bea9-40a3-8091-ab87d3e19559 could not be found. {{(pid=124467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:50:16.683139 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO nova.api.openstack.requestlog [None req-7b75db5a-069e-451a-9324-8b61a1c248bd tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559" status: 404 len: 111 microversion: 2.1 time: 0.030683 Jul 25 05:50:16.683139 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: [pid: 124467|app: 0|req: 556/1101] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 25 05:50:16 2022] GET /compute/v2.1/servers/2221cc83-bea9-40a3-8091-ab87d3e19559 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:50:16.839650 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0f1c3690-93fc-44d4-95e3-8b2d959ae923 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] Calling method '.version_select at 0x7fcc844ce940>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:50:16.843787 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0f1c3690-93fc-44d4-95e3-8b2d959ae923 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [5f03247a-fe72-4267-9ecb-78aa8cc34637] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 05:50:17.851812 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO oslo.messaging._drivers.impl_rabbit [None req-0f1c3690-93fc-44d4-95e3-8b2d959ae923 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] [5f03247a-fe72-4267-9ecb-78aa8cc34637] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34638. Jul 25 05:50:17.869698 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0f1c3690-93fc-44d4-95e3-8b2d959ae923 tempest-TestShelveInstance-38130555 tempest-TestShelveInstance-38130555-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-873262384" status: 202 len: 0 microversion: 2.1 time: 1.035193 Jul 25 05:50:17.870282 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 546/1102] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 25 05:50:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-873262384 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 05:50:51.435324 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 05:50:51.435957 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Mon Jul 25 05:50:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 05:52:32.436359 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 05:52:32.437179 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Mon Jul 25 05:52:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 05:52:35.562317 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 05:52:35.562905 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Mon Jul 25 05:52:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 05:52:39.961624 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 05:52:39.962173 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Mon Jul 25 05:52:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 05:54:11.443671 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 05:54:11.444465 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Mon Jul 25 05:54:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 05:55:18.961098 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 05:55:18.961901 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Mon Jul 25 05:55:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 05:55:33.115611 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 05:55:33.116188 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Mon Jul 25 05:55:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 05:55:52.445596 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 05:55:52.446170 dv-cinder-850830-1-iscsi devstack@n-api.service[124467]: Mon Jul 25 05:55:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 05:55:55.569865 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 05:55:55.570619 dv-cinder-850830-1-iscsi devstack@n-api.service[124466]: Mon Jul 25 05:55:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!